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CHAPTER  I 


INTRODUCTION  AND  SUMMARY 


1.1.  Statement  of  the  Problc 


Suppose  that  X  Is  an  n-dlaenslonal  random  vector  that  is  normally 
distributed  with  mean  zero  and  covariance  matrix  which  is  in  fact  a 
correlation  matrix.  For  a  given  constant  c,  compute  the  probability  of 
A^(c)  -  {k  of  the  n  components  of  X  exceed  c}:  this  is  the  problem 
that  motivated  the  work  contained  herein.  Denote  the  normal  density  with 
mean  zero  and  correlation  matrix  $  by  $(*•$);  then  the  answer  to  this  pro¬ 
blem  is  just  -\k(c)  4>(x;$)dx*  This  n -dimensional  integral  is,  however, 
quite  useless  in  general.  Rarely  can  it  be  expressed  in  terms  of  elemen¬ 
tary  functions;  also,  simulation  and  numerical  integration  in  many  dimen¬ 
sions  are  known  to  be  prohibitively  expensive  and  they  do  not  provide 
general  results.  Our  aim  is  to  find  approximations  to  the  above  Integral 
that  are  easy  to  evaluate.  In  our  search  for  these  approximations,  we 
have  been  able  to  extend  or  Improve  upon  previously  known  results  and 
we  have  discovered  several  interesting  facts,  which  we  also  present. 


1.2.  Review  of  Earlier  Work. 

The  problem  of  evaluating  multivariate  normal  probabilities  arises 
in  many  contexts.  In  fact  whenever  we  wish  to  know  the  sampling  proper¬ 
ties  of  a  test  statistic  or  to  make  inferences  when  the  population  is 
(postulated  to  be)  multivariate  normal,  we  may  expect  to  face  this  problem. 
TWo  examples  of  these  applications  are  the  following: 
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(i)  The  moments  of  certain  nonpareaetric  test  statistics  whan 
the  population  la  normal  require  orthant  probabilities  — 
see,  e.g.,  Moran  [18],  who  studies  Spearmen’s  rho. 

(ii)  The  construction  of  simultaneous  confidence  intervals  for 

the  mean  of  a  multivariate  normal  distribution  often  involves 
probabilities  of  rectangles  —  see,  e.g.,  the  books  by  Miller  [17], 
and  Tong  [34].  In  fact,  Tong  says  that  this  topic  is  "perhaps 
a  major  source  leading  to  the  development  of  certain  probability 
Inequalities."  (p.  165) 

As  we  shall  see  later,  when  $  has  special  structures  such  as 
equicorrelation  or  single  latent  factor,  probability  computations  are 
fairly  Inexpensive,  since  they  Involve  single  Integrals;  however,  effi¬ 
cient  solutions  have  not  been  found  in  general.  Many  attempts  to  find 
efficient  techniques  have  been  made,  and  most  of  the  methods  proposed  fall 
into  one  of  several  Categories  which  we  describe  briefly. 

(1)  Reduction  of  dimensionality.  In  certain  special  cases,  we  can 
reduce  the  problem  to  that  of  evaluating  a  single  or  double  Integral,  which 
is  fairly  inexpensive.  For  the  general  case.  Placket t  [20]  uses  a  partial 
differential  equation  satisfied  by  $(x;$)  to  provide  a  formula  that 
expresses  n -dimensional  Integrals  in  terms  of  lower  dimensional  Integrals. 
His  method  is  cumbersome,  however,  and  he  admits  that  'Vhethar  (his) 
results  offer  a  practical  method  of  approach  when  n  exceeds  4  is  a  moot 
point."  (p.  358)  His  approach  has  much  theoretical  Interest,  though,  for 
it  elaborates  upon  the  connection  between  the  evaluation  of  orthant  proba¬ 
bilities  and  computation  of  the  volume  of  certain  slmpllces  on  the  (n-dinsn- 
slonal)  unit  sphere.  The  latter  problem  was  extensively  studied  by 


Schlafli  [25]  In  the  nineteenth  century.  Ruben  [21,22,23]  wrote 
several  papers  that  have  a  similar  bent.  These  methods  are  quite 
sophisticated  mathematically,  but  they  seem  quite  cumbersome  In  practice. 

(II)  Asymptotic  expansions.  Another  theoretically  appealing  approach 
Is  to  write  the  probability  (which  Is  a  function  of  $)  in  one  of  several 
infinite  series  expansion.  Kendall  [11] expanded  bivariate  normal  prob¬ 
abilities  In  terms  of  tetrachorlc  functions  and  Moran  [18]  suggested  the 
method  for  the  quadrlvariate  case.  They  both  found,  however,  that  the 
series  were  useful  only  locally;  that,  in  general,  they  converge  very 
slowly.  To  overcome  this  problem,  several  authors  (McFadden  [13],  Sondhi 
[29])  used  a  nonlinear  ser'es-to-series  transformation  suggested  by 
Shanks  [26]  to  accelerate  the  convergence  in  some  special  cases.  To  use 
Shanks'  technique,  we  need  to  know  the  coefficients  of  several  terms  In 
the  original  series,  and  this  points  to  yet  another  difficulty  with 
asymptotic  expansions:  these  coefficients  are  in  general  very  hard  to 
compute.  In  many  cases,  they  Involve  complicated  symmetric  functions;  in 
some  examples  that  we  tried,  it  can  be  shown  that  the  coefficients  are 
zonal  polynomials  (Takemura  [33]),  which  are  known  only  for  the  simplest 
cases.  Thus,  although  a  series  expansion  may  be  useful  theoretically  (In 
Chapter  2  we  will  provide  a  heuristic  argument  using  it) ,  the  computational 
difficulties  that  it  Introduces  usually  render  it  useless  in  practice. 

(III)  Probability  Inequalities.  The  recent  books  by  Tong  [34] 
and  Marshall  and  Olkin  [16],  end  the  expository  article  by  Baton  [7] 
attest  to  the  fact  that  the  subject  of  probability  Inequalities  in  multi¬ 
variate  distributions  is  vast.  We  make  no  attempt  to  review  the  literature 
hare.  Perhaps  the  simplest  inequality  concerning  the  normal  distribution 
is  an  elegant  one  first  proved  by  Sleplan  [28]: 
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Lemma  1.1;  Suppose  X  Is  normally  distributed  with  mean  aero  end 
correlation  Let  R  end  T  be  correlation  matrices.  Then  for 
all  a1,...,an  we  have  Pj-R  (X1>ai,  VI)  >_  (X^  >  »±*  ▼*)  whenever 

r y  for  all  1, j . 

Much  work  has  been  done  to  find  nore  general  classes  of  distributions 
(e.g.  Das  Gupta,  et  al.  [3])  and  other  classes  of  regions  (Sidak  [27], 
Khatrij[li9)  for  which  similar  inequalities  hold.  Our  aim  here  is  different. 
We  take  a  closer  look  at  Sleplan's  inequality  in  the  normal  case  and  "improve" 
upon  it.  The  reason  that  we  put  quotes  around  improve  is  that  our  method 
does  not  always  yield  an  inequality  but  it  gives  a  much  better  approxima¬ 
tion  than  does  Sleplan.  This  is  a  phenomenon  that  we  shall  see  again  when 
we  study  Mills'  ratio:  when  we  have  an  inequality,  it  Is  a  bad  approximation; 
when  we  have  a  good  approximation,  we  no  longer  have  the  inequality  that  we 
desire. 

(iv)  Mills'  Ratio.  For  certain  problems,  we  need  "simultaneous  tail 
probabilities,"  P{X^>a1,  Vi),  where  the  a^  are  large.  In  these  cases, 
the  multivariate  Kills'  ratio  R(a,$)  -  P^(Xi> a^Vi) /4>(a,$)  (a- (a1,...,an)' 

becomes  useful.  Much  work  remains  to  be  done  on  this  topic.  In  an  early 
paper.  Savage  [24]  generalized  the  univariate  case  in  a  straightforward  manner 
Recently  Steck  [32]  showed  that  Savage's  methods  are  often  inapplicable 
(because  his  conditions  are  too  stringent).  He  then  introduced  three  simple 
approximations  to  R(a,$)  in  terms  of  the  univariate  Mills'  ratio,  and  he 
showed  some  numerical  examples.  He  was  able  to  show  that  two  of  the  approxi¬ 
mations  were  Indeed  lower  bounds  to  R(a,$),  but  he  did  not  study  the  third 
approximation,  which  appeared  to  be  the  best  of  the  three  (In  the  sense  that 
it  yielded  the  largest  lower  bound).  After  studying  this  topic,  we  have 
bean  able  to  give  a  partial  answer  to  Stock's  conjecture  about  the  third 
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approxiaation;  we  have  also  been  able  to  "fine  tune"  his  aethod  to  yield 
some  Improvements. 

Finally  there  have  also  been  several  methods  introduced  (e.g.  Henery 
[10],  McFadden  [14])  that  take  advantage  of  some  special  structure  in 
They  do  not  Immediately  fall  Into  any  of  the  categories  that  we  have  listed 
above. 

One  feature  that  we  have  noticed  in  the  earlier  literature  is  that 
some  authors  get  very  accurate  results  (numbers  that  are  correct  to  the 
third,  fourth,  or  even  fifth  decimal  place),  using  methods  that  are  hard 
to  apply  —  see,  e.g.  Steck  [30],  Plackatt  [20].  Our  approach  is  different. 

Oir  methods  are  very  simple  to  apply,  but  they  typically  yield  approxima¬ 
tions  that  are  good  to  the  second  (and  sometimes  only  first)  decimal  place.  If 
we  desire  more  accuracy,  we  must  do  more  mathematics  to  find  other  methods, 
and  can  expect  that  they  will  be  harder  to  apply. 

1.3.  Notation. 

Let  A^(c)  "  fk  components  of  X  exceed  c},  and  p£n^  “  p(k,n,c,$)  - 

P^AfcCc)) .  If  SQ  -  Ej  I{X1>c},  then  p£n^  »  P{Sn*k}.  Thus  we  may  regard 

(p^n\ . . .  ,p^)  as  a  probability  distribution  —  we  call  it  the  exceedance 
o  n 

distribution  —  on  the  Integers  {0, . . . ,n) .  Furthermore,  since  X  and  -X 
have  the  same  distribution,  we  may  assume  without  loss  of  generality  that 
c  _>  0.  Finally,  let  $(x)  and  $(x)  be  the  standard  univariate  normal 
density  and  distribution  functions,  respectively. 

1.4.  Summary  of  Present  Work. 

In  Chapter  2,  we  introduce  an  approxiaation  to  the  exceedance  distri¬ 
bution  for  arbitrary  t,  and  than  refine  it.  We  also  provide  numerical 
examples  which  Indicate  when  our  methods  are  good. 


In  Chapter  3,  we  prove  a  variance  inequality  and  use  it  to  modify 


Slepian'?  inequality  for  orthant  probabilities.  We  then  consider 
the  case  of  large  c  via  Mills'  ratio:  we  use  a  new  result  for  the  one¬ 
dimensional  Mills'  ratio  to  prove  an  Inequality  for  the  multi-dimensional 
Mills'  ratio. 

The  equlcorrelation  case  plays  a  central  role  in  our  work.  Much  has 
been  written  about  it  because  its  symmetry  makes  it  mathematically  tractable. 
We  have  some  Interesting  new  results  that  comprise  Chapter  4. 

Chapter  5  has  some  miscellaneous  results.  One  section  contains 
some  work  on  asymptotic  expansions  that  well  illustrate  the  difficulties 
encountered.  The  other  section  contains  some  combinatorial  results  for 
some  special  cases. 
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CHAPTER  II 


AN  APPROXIMATION 

2.1.  Approximation  by  Equlcor relation  Case. 

Notice  that  the  event  A^(c)  is  invariant  under  permutations  of 
the  coordinates  of  X.  Thus 

PjCXeA^c))  -  P^CirXe  A^(x))  -  p^.fXe^lc))  , 

where  ir  is  a  permutation  matrix.  With  this  in  mind,  let  Y^^  he 
distributed  as  N(0,ir^Trp  for  i  ■  l,...,nl.  Also,  let  {Y^}°*  be 
independent.  Let  N  be  uniformly  distributed  on  {l,...,n!}  indepen¬ 
dently  of  X  and 

The  exceedance  distribution  for  is  the  same  as  that  for  X. 

This  is  because 


PjCAj^OlN-i)  -  J 


Ak(c) 


<t>_  *  ,(x)dX 

V"i 


and 


p*(Vc))  -EPt<Vc)li«-i)  -  {  ST 


-  [  m(x;$)dx  , 

JVC> 


where  m(x;$)  ■  I  Here  m(x;$)  is  not  a  normal  density  function 

it  is  rather  a  mixture  of  normals.  But  If  a  random  vector  M  has  density 

m(x;f),  the  EM  -  EE(MjN)  -  0  and  EMM'  -  EE(MM' |N)  -  ,  where 

P 
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t-'sf  I  *iK 

P  1 

is  an  equicor relation  matrix  with  parameter  "p  which  ia  the  average 

of  the  off-diagonal  terms  of  Our  approach  here  is  to  sieply  replace 

the  non-normal  density  m(x;f)  by  a  normal  density  with  the  same  first 

two  moments:  4>{x;$_). 

P 

2.2.  The  Equicorrelation  Case. 

Of  course,  the  above  argument  would  be  fruitless  if  the  equii  »■ 

tion  case  were  not  easily  computable.  That  it  is  easy  is  proved  in 

Theorem  1.  If  X  ^  N(0,$),  where  $  is  an  equicorrelation  matrix  with 
p  ^  0,  then 


PCA^c))  -  <") 


[  V  ^>k 

/Uo 


/^P 


n-k 


<j>(t)dt  . 


Proof .  Let  Zn,Z,,...,Z  be  iid  N(0,1)  variates.  Let 
__ _  u  l  n 

Y^  ■  /l-p  Z^  -  /p  Zq,  i  *  1 . n.  Then  Y  “  (Y^ . Yft) '  has  the  same 

distribution  as  X.  So  if  we  note  that  the  X^'s  are  exchangeable  and 
condition  on  the  main  effect  Zq,  we  get 


P(Ak(c))  -  (£)  P^  >  cl.<.lxk>c,Xk+1<c . XQ<c) 


■  <:>  f  *«,  >  . . z  <^)«<t)« 

k  Leo  1  /r=?  k  /r*  16+1  /r=p  n  /r* 


'-00  /l-p  /l-p 


QED 
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We  pause  now  to  take  a  closer  look  at  this  result.  The  expressions 
for  are  easily  evaluated  because  we  have  a  one-dimensional  Integral 

Involving  the  well-tabulated  functions  4  and  <J>.  Gaussian  quadrature  as 
described  in  Abramowitz  and  Stegun  [1]  yields  satisfactory  results. 

In  the  theorem  above,  we  require  P  ^  0.  In  order  to  generate 
exchangeable  sequences  with  negative  correlation,  we  may  take 

-  A+p  Z±  +  v^p  ZQ,  where  Z1,...,Zn  are  iid  N(0,1)  but  now 
corrCZg.Zj)  -  -  ✓- p/(l-p ) .  Unfortunately,  the  method  of  conditioning 
does  not  yield  any  useful  results,  for  Z^,...,Zn  are  not  conditionally 
independent.  Recall  that  p  >  -  »  80  ^or  l*r8e  n»  $ 

be  very  close  to  the  identity.  We  shall  see  later  that  {p£n^}  are 
very  smooth  functions  of  the  components  of  so  that  for  -  <  P^_0, 

the  exceedance  distribution  will  be  approximately  a  binomial. 

But  the  expression 

pk° "  <k>  r  *<■  £±^>k  (£±£^>r  k  ^(t)dt 

'  A-p  A-p 

Is  formally  correct,  even  for  p  <  0,  because  of  the  following  argument 
that  is  due  to  Steck  [22],  If  we  define  $(z)  for  z  -  x+iy  by 
Integrating  along  the  line  {t+iy:  -®  <  t  x},  then 

$(z)  -  ey  [  e“ity$(t)dt  -  E(e-iyX  I{X £x})/Ee"lyX 
J  —00 

where  X  'v  N(0,1).  Steck  then  presents  an  argument  to  show  that 
<  c,...,X„  <  c)  -  f  *(t)dt  for  p  <  0; 

n“  J-co  A^p 
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evidently  the  integral  of  the  Imaginary  part  is  zero.  A  simple  computa¬ 
tion  shows  that  we  still  have  $(-z)  ■  l-$(z) .  Thus,  an  inclusion- 
exclusion  argument  yields  the  formula  for  p£n^ .  Steele  remarks,  though, 
that  it  "does  not  appear  feasible  to  isolate  the  real  part  of  the 
integrand,"  and  so  provides  another  formula  for  Fn(c|p)  hP(3^<^c^,...,Xq£c) 


Fn(c|p) 


n 


I 

k-l 


(-1)k(J)Fk(ancipn)Fn-k(c|p) 


t 


where 


1=£- 


,.-7-  and  p_ 


For  the  special 


(l+(j-l)p)(l+(j-2)p)  Mn  l+(n-2)p 

case  c  “  0,  he  uses  a  recursion  formula  due  to  David  [4]  to  get 


tfi 


Fn(°|p)  “  2  ~  .L  ( 2j ) Fk(0 1 1+( 2j -2) p) Fn-k(° ^ 1+2 j p* 


j-1 


The  last  formula  has  the  advantage  that  there  are  only  [^1  terms  in 

the  sum  and  each  term  is  positive.  Later,  we  shall  present  some  Taylor 

series  approximations  to  Fn(c]p)  that  are  quite  easy  to  apply.  For 

(2) 

the  special  case  n  -  2,  though,  p£  '  can  be  evaluated  exactly.  We 
can  generate  a  negatively  correlated  bivariate  normal  (X^.X^ '  thus: 

■  /l+p  Z1  +  | pZQ  and  X2  *  /l+p  Z 2  -  ZQ,  where  Z0,Z^,Z2  are 

independent  standard  normal  variates.  Than  it  is  easy  to  see  that 


p(x  >c,  x  >c>  -  r »(-  $(_  «^(t)dt , 

'•<*>  /l+  p  /1+p 

PCX^c,  X2<c)  -  f  <f(t)dt  ,  and 

>-to  /l+p  /1-p 

P{2)  -  2  r  $(.  «(t>dt . 

)  -or  /1+p  /1+P 
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Because  of  the  symmetry  In  the  equicorrelatlon  case,  there  are 
many  interesting  results  that  are  analytically  tractable.  We  will 
return  to  them  later,  and  now  say  more  about  our  approximation  technique. 


2.3.  Local  Argument  for  Approximation. 


We  will  see  later  that  approximating  m(x;$)  by  4>  (*;$__  )  does 

P 

not  always  work  well.  In  fact,  as  the  dispersion  among  the  {p^}, 

_  2 

E  (p..-p)  ,  gets  bigger,  the  approximation  often  gets  worse.  It  may 
i<  J  13 

be  tempting  to  use  some  other  index  of  the  center  of  the  {p^},  e.g. 
the  median,  but  the  following  argument  supports  p,  at  least  locally. 
We  first  need  Plackett's  identity,  which  is  proved  in  [20]: 


_2:  If  t  m  (Py)  Is  a  correlation  matrix,  then 


Typically,  we  are  interested  in  probabilities  as  a  function  of  80 

we  may  expect  to  differentiate  with  respect  to  p^ .  However,  the  normal 
density  contains  the  terms  j$|~  7  and  x'$  x,  which  are  quite  hard 
to  handle.  Plackett's  identity  simplifies  matters  by  allowing  us,  instead, 
to  differentiate  the  quadratic  form  x'$  with  respect  to  x.  We  will 
use  it  many  times  in  the  sequel. 

Wow  suppose  that  for  a  given  £  we  want  to  expand  about  some 

equicorr elation  Consider  T(6)  -  (1-8)^  +  6$ •  Write 

Pfc^O)  "  ^A^(c)  •“d  expand  in  the  Taylor  series: 


p£n)(e)  -  P^n)(o)  +  epin),co)  +  ipW-w  +•••  . 
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Plackett's  identity  and  the  chain  rule  glvea 

P<n)  (0)  -  l  (P41'P)  (  x  x  <Kx;t  )dx 
k  i<J  y  \(t)  13  p 

“  {  I  (p4i-p)}  f  *,x2  *(x;t  )dx  , 
i<J  y  \(c)  1  2  P 

where  the  second  equality  is  due  to  exchangeability.  Thus,  the  first  deriva¬ 
tive  vanishes  when  we  choose  p  ■  p  ■  [  p../(2).  Locally,  then,  if 

i  <  J  ^  2 

is  of  order  6,  the  difference  in  the  respective  exceedance 
p  2 

probabilities  is  of  order  9  .  The  argument  given  above  applies  locally; 
as  6  approaches  1,  the  higher  order  terms  potentially  play  a  large  role. 
Also,  the  Taylor  series  is  of  theoretical  value  only.  Computation  of  the 
higher  order  coefficients  seems  feasible  only  when  p  -  0;  even  in  that 
case,  the  computations  are  quite  hard.  We  show  some  details  and  give 
some  numerical  results  in  section  5.1. 

2.4.  Interpretations  of  Approximation  and  Extensions. 

There  are  at  least  three  other  ways  of  interpreting  the  approx i- 

P 

mat ion  that  we  Introduced.  Only  one  of  them  has  proved  fruitful;  we  briefly 

mention  the  other  two  and  then  delve  into  the  fruitful  one.  (i)  is 

1  P 

the  average  of  $  over  the  permutation  group:  $  ■  — r  Z  ir$ir'.  Our 

P  n*  IT 

problem  does  not  seem  to  be  invariant  under  other  subgroups  of  the 

orthogonal  group,  6^.  Averaging  $  over  8^  or  the  group  of  sign  changes 

yields  the  Identity,  (ii)  We  earlier  approximated  m(x;$)  by  4(x;|L) 

P 

by  fitting  the  first  two  moments.  It  may  be  worthwhile  to  try  an  Edgeworth 
expansion  by  considering  fourth  moments  also  (the  third  moments  are  aero). 

We  have  not  been  abLe  to  carry  this  idea  far.  Now  we  turn  to  an  idea  that 
yields  nice  results. 
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t_  is  the  projection  of  $  onto  the  set  of  equlcorr elation  matrices 
under  the  norm  ||a-b||  «  {  I  (a .. -b . . .  But  there  ie  a  larger  class 
of  correlation  matrices  that  yield  one-dimensional  integrals  for  p£n* . 

If  we  consider  - ✓  l-o^  Zi~0L±ZQt  wlth  laJ  <  then  x  has 
correlation  matrix  t  *  (o^),  °ij  “  aiaj»  1  t  j«  is  called  a  "single- 
factor  matrix"  in  one  context  of  factor  analysis.  In  this  case,  we  have 


r  *  C4V]  « 

-  I  I  n  *  -  — n  *  J-  ♦(t)dt 

A^2  J-k+1  /H2 


c+a.  t> 


where  the  summation  is  taken  over  the  (°)  terms  corresponding  to  the 
subevents  that  make  up  A^(c) .  p£n^  is  still  given  in  terms  of  a  one- 
dimensional  integral,  but  because  we  no  longer  have  exchangeability,  we 
cannot  avoid  the  task  of  enumerating  the  (£)  subevents  that  comprise 

VO. 

The  set  of  n*n  single-factor  matrices,  3.  contains  the  set  of  aqul- 
corr elation  matrices,  £.  3  is  much  larger  than  £:  7  is  described 
by  n  parameters,  £  by  just  one,  and  the  set  of  all  correlation  matrices, 

8,  by  (“)  parameters.  If  we  picture  g  by  plotting  (Pi2*P13‘ ' *  *  »p  1  > 

<*> 

in  »  ,3  and  £  are  lower  dimensional  subsets  when  n  >  4.  But  when 

n  -  3,  n  ■  (°),  and  3  is  an  open  set  in  g.  in  fact,  in  the  region 

Py  >0,  3  is  characterised  by  P12P13P23  <  ■in(p12,p13*p23>* 

The  projection  of  $  onto  3  is  closer  to  $  than  $  is.  Finding 

P  2 

the  projection  onto  3  is  hard,  for  it  requires  minimising  £  (p,,-a  a  ) 

i,j  «  1  i 

over  {<Oj, . . . ,an) :  |a^|  <  1,  fl>,  which  is  a  restricted  nonlinear  least 
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squares  problem.  It  would  be  pointless  to  replace  one  hard  problem 
(multi-dimensional  Integration)  by  another  hard  one,  so  we  tried  a 
simple  (ad  hoc)  method  that  gave  good  numerical  results.  This  alter¬ 
native  Is  to  use  a  standard  maximum  likelihood  fitting  procedure  (as 
provided  by  BMDP  or  SPSS)  to  get  the  loadings  o^,...,ctn. 

This  last  suggestion  Is  based  on  practical  considerations  only. 

We  motivated  the  f_  approximation  by  replacing  a  mixture  of  normals 

P 

by  a  normal  with  the  same  first  two  moments.  There  does  not  seem  to 
be  any  such  "statistical"  justification  for  the  single-factor  model 

approximation.  We  also  showed  that  was  locally  optimal  among 

P 

all  equicorr elation  matrices  by  requiring  that  the  first  derivative  In 
a  certain  Taylor  expansion  vanish.  If  we  use  a  Taylor  expansion  about 
an  arbitrary  single-factor  matrix,  G,  the  first  derivative  becomes 


l  ♦(*;F)dx  ; 

i<  j  ^  1J  Afc(c)  iJ 

the  integral  is  not  independent  of  i  and  j,  and  it  depends  upon  all 

the  's.  It  is  impractical  to  set  this  expression  equal  to  zero  and 

then  solve  for  a. . a  .  What  we  are  left  with,  then,  is  that  the 

single-factor  matrix  given  by  the  maximum  likelihood  fitting  procedure 

is  closer  to  $  than  is,  so  it  ought  to  give  better  approximations 

P 

than  t_.  It  does  not  always,  but  as  we  see  frcv*  the  numerical  examples 
P 

it  can  give  substantial  improvement  over 

P 
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The  column  labelled  "phat"  contains  the  simulated  vtlues  of  the  exceedence 
probabilities;  that  labelled  "error"  contains  the  estimated  standard  errors 
for  the  simulation  value;  and  the  column  labelled  "equi"  contains  the  t 

p 

approximation.  It  is  clear  from  the  data  that  the  approximation  is 

P 

excellent  when  all  super -diagonals  are  non-zero.  When  some  of  the  super¬ 
diagonals  are  zero,  the  approximation  gets  worse;  but  as  we  can  see  from 
the  case  n  -  10,  diag  ■  2,  p  ■  .5,  the  approximation  is  still  good. 

The  second  part  of  Appendix  1  provides  a  direct  comparison  of  the 

£_  and  single-factor  approximations.  We  selected  correlation  matrices 

P 

from  the  books  by  Anderson  [2],  Morrison  [19],  and  Mardia,  Kent,  and 
Bibby  [ IS] ,  used  BMDP ' s  factor  analysis  package  to  get  the  maximum  like¬ 
lihood  loadings,  computed  the  two  approximations,  and  compared  them  to 
the  simulation  results.  Sometimes,  the  BMDP  routine  would  return  an 
value  of  1,  which  is  not  appropriate  for  our  purposes  (since  we  must 
divide  by  J 1-a^  to  compute  ) ;  we  replaced  such  values  by  ,95. 

In  the  appendix,  we  write  $,  the  fitted  ot^'s,  and  the  constant  c. 

The  columns  labelled  "phat",  "error",  and  "equi"  are  as  above,  and  that 
labelled  "m.l.  fit"  contains  the  single-factor  approximation.  The  row 
labelled  "distances"  contains  the  distance  from  the  simulated  vector 

p  ■  (Pq11^ , . . . ,P^n^)  and  the  approximation  q  -  (q^, . . . ,q^n^)  :  distance 

■  {E  (p^-q^)^}1^.  Of  course,  other  distance  functions  may  also  be 
appropriate,  but  our  choice  here  seams  quite  reasonable. 

It  is  evident  that  the  single-factor  approximation  is  often  excellent, 

and  is  never  a  bad  approximation.  The  approximation  can  do  very 

P 

badly  because  the  exceedance  distributions  for  equlcorrelatlon  matrices  are 
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CHAPTER  III 


A  CLOSER  LOOK  AT  ORTHAMT  PROBABILITIES 


3.1.  A  Variance  Inequality. 

We  begin  with  a  simple  but  useful  leans. 

Lemma  3.1:  Let  X  be  a  vector  which  has  a  bivariate  normal  distribution 
with  mean  zero  and  covariance  matrix  $  ■  (p  £).  For  each  fixed  c  _>  0, 
f(p)  ■  Pp{X1  >  c,X2  >  c}  is  convex  for  pe(0,l).  For  each  fixed  c>/5f-l, 
f  is  convex  in  (-1,1).  For  c  ■  0,  f  is  convex  in  (0,1)  and  concave 
in  (-1,0). 


Proof.  Let  n(x;$) 


9x13x2 


4>(x;$).  By  Plackett's  identity,  we  have 


f-(p>  -  -4  r  r  ♦<«*>«*  -  r  r  -4  ♦<«**>* 

3p  Jc^c  Jc^c3p 


r  r  _sl_ 

Jc  Jc  9xlSxi 


n(x;t)dx  -  n((c,c);$) 


+  c2r?}  • 

i-p 


The  Interchange  of  differentiation  and  Integration  above  is  easily  justified. 
The  sufficient  conditions  for  f"  >  0  and  f"  <  0  mentioned  in  the  lemma 
are  easily  verified  by  checking  the  sign  of  (p  +  c2  •  QED 
Now  let 


h({p  ,})  -  var*S  -  n*(-c)-n2*(-c)2  +  T  ?  (X.  >c,X4>c)  ; 

U  f  n  il»J  PU  1  J 

the  variance  of  the  exceedance  distribution  can  be  written  in  terms  of 
bivariate  quadrant  probabilities  (similarly,  the  k**1  moment  of  the  exceedance 
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distribution  is  expressible  in  tens  of  k-dlaanslonal  orthant  probabilities) , 
Using  Lena  3.1,  it  is  easy  to  see  that  the  Hessian  of  h  is  positive 
definite  whenever  (i)  p^  >  0  Vi,J  or  (ii)  c>/T-l,  and  negative 
definite  whenever  c  -  0  and  p^  <  0  Vi,J .  With  this  in  alnd,  we  have 

Theorea  3.1:  If  (i)  p^  >  0  Vi,J  or  (ii)  0*^-1,  then 

vsr^SQ  >  varj  Sq.  If  c  -  0  and  <  0  Vi,j,  then  varfSQ  <  varx  Sft. 

P-  U- 

Note.  The  theorea  reaains  true  if  we  appropriately  replace  the  strict 

inequalities  by  weak  ones. 

Proof .  The  function  h  defined  above  is  a  synaetric  (strictly)  convex 
function  whenever  (i)  or  (11)  hold;  hence  it  is  Schur  convex  (see  Marshall 
and  Olkln  Il6],  pp.  64-68).  Since  (p12* *  *  * ,pn-l  v?  maJoriBe8  (p.F.  •••»?>). 
we  have  h({p^})  >_  h(p,p, . . .  ,p)  .  The  proof  for  c  -  0,  <  0  is 

analogous.  QED 


py  >  0,  Vi, j .  We  know 


3.2.  An  Application  of  the  Variance  Inequality. 

Consider  for  the  moment  the  case  c  -  0,  and 

that  the  naan  of  the  exceedance  distribution  is  n/2  and  by  Theorem  3.1 

above  we  know  that  the  exceedance  distribution  is  aore  concentrated  under 

then  under  $.  i»  tempting  to  conjecture,  then,  that 
P 


p$<v° . V0)  £ VX  (x1>0,...,xn>0) 


Indeed,  for  n  -  3,  it  is  well  known  that 


P^(X^  y  0,Xj  >  0,X^  >  0)  ■  ^  (cos  p^2  +  c°i  Py  ^ P2j)  » 
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which  is  a  convex  function  of  ^12*^13^23^ *  t^us*  the  inequality  above 
does  hold.  Such  a  result  is  not  true  in  general,  however,  as  is  seen  by 
the  following  example: 


t- 


f 1.0  0.5  0.5  0.0 

1.0  0.5  0.0 

1.0  0.0 
1.0 


.25  ,  c  •  0 


Pj.(X.  >  0,  VI)  “  .1250,  whereas  the  corresponding  probability  for  is 

*  1  p 

.1265.  (Of  course,  the  fact  that  we  have  some  zero  off-diagonal  terms  in 
X  is  not  the  problem;  we  could  just  change  them  by  some  small  e) .  What 
does  seem  to  be  true,  however,  is  that  p ^  +  p£n^  under  %  exceeds  the 
corresponding  sum  under  £  ,  although  we  have  not  found  conditions  for  that. 

15* 

We  have  also  found  in  our  numerical  examples  that  although  the  inequality 
p*(Xi>  0,  Vi)  >  Pj  (X1>  0,  Vi)  does  not  hold.  Pj  (X±>  0,  Vi)  provides 

■p  "p 

a  much  better  approximation  to  P^CX^  >  0,  Vi)  than  the  method  suggested 
by  Tong  [34]  and  Steck  (30]  —  their  method  uses  Slepian's  inequality.  Tong 
suggests  bounding  the  desired  probability  above  and  below  by  using  equi- 
corr elation  matrices  with  ^ 

but  these  bounds  are  often  useless,  as  we  see  from  the  following  table.  We 
took  the  first  three  examples  from  the  second  part  of  Appendix  1. 


.  Oy  and  p>ln 
IfJ 


min  p^,  respectively. 


Probability 

Our  Approximation 

Upper  Bound 

Lower  1 

.216 

.214 

.27  2 

.164 

.134 

.135 

.228 

.106 

.059 

.058 

.105 

.022 

.194 

.173 

.290 

.057 

.056 

.049 

.174 

.033 

Notice,  especially,  that  even  when  the  X  approximation  is  bad  for  the 
whole  exceedance  distribution,  it  does  quite  well  in  approximating  p^n* . 
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for 


Of  course,  whan  c  is  so  largo  that  p^  exceeds  p£n^ 
k  -  then  the  $_  approximation  will  serve  as  an  "upper 

bound"  to  the  true  p^  and  a  "lower  bound"  for  p^ ;  we  use  quotes 
here  because  although  we  do  not  always  have  a  proper  bound,  we  generally 
have  a  good  approximation. 

We  now  briefly  mention  an  application  of  these  ideas  to  the  construc¬ 
tion  of  convervative  simultaneous  confidence  sets.  Suppose  that  we  observe 

. lid  N(y,$)  with  $  known,  and  we  wish  to  get  one-sided 

confidence  bounds  for  y.  That  is,  we  consider 

R  «{te  +  i"l» •••#»)  • 

How,  if  >  0,  we  get  Pj.(yeR)  >_  PjCyeR) .  Tong  [34]  suggests  that  if 

we  choose  d±  2  d,  where  d  satisfies  $(/»  d)  »  (y)1^0,  the  confidence 
is  at  least  y.  Be  also  suggests  that  if  >  p>0,  then  "a  less  con¬ 

servative  solution  can  be  obtained  by  letting  d  satisfy 

n 

P*  <n  (X.  </n  d))  -  y," 

*pl  1 

where  is  an  equicor relation  matrix  with  correlation  p  .  The  dis¬ 

cussion  above  indicates  that  we  get  a  much  more  accurate  estimate  for 
the  confidence  coefficient  for  the  confidence  regions  if  we  use 
p"  -  -i-  T  p  Instead  of  p  ■  nin{p,,}.  We  do  not  always  get  a 

(J)  i<j  ^  U 

conservative  approximation  for  the  probability.  However,  we  do  in  general 
gat  a  much  better  approximation  than  Tong's  suggestion  (which  is  an  appli¬ 
cation  of  Slepian's  inequality)  yields. 
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defines  an  exponential  family  through  V  with  ]R  as  the  natural  parameter 
space  (here  -x  takes  the  place  of  the  symbol  6  in  the  usual  literature). 
Let  U  be  any  random  variable  with  distribution  Px(dt) • 

Differentiating  the  relation  (*)  with  respect  to  x  several  times 

d  00 

(interchanging  ^  and  are  easily  justified),  we  get 
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(1)  R  is  a  strictly  convex  decreasing  function  with 


R(°)  -  J\  . 

(ii)  E^W  ■  -  S'(x)  «  -  ■  y(x)  >0  (y  refers  to  mean.) 

(iii)  -y'(x)  -  S"(x)  -  varxw  >  v'M  <  0. 

Civ)  y"(x)  -  Ex(W-y(x))3  . 

When  we  try  to  prove  certain  inequalities  for  the  multivariate  Hills' 
ratio,  we  will  need  the  signs  of  y,  y'  and  y".  The  sign  of  y"  is  very 
hard  to  determine  by  using  the  standard  approximations  for  R,  but  the 
following  observation  makes  the  problem  easy.  Notice  that  y"  is  the 
third  central  moment  of  W.  The  third  central  moment  of  any  random  variable 
is  proportional  to  a  standard  measure  of  skewness;  furthermore,  the  distri¬ 
bution  of  W  is  the  same  as  that  of  a  N(-x,l)  variate  conditioned  on  the 
event  that  it  is  positive.  It  is  clear  that  W  has  a  positively  skewed 
density,  and  hence  y"  >  0.  This  fact  is  in  fact  a  special  case  of  the 
following  lemma. 

Lemma  3.2;  Suppose  X  has  density  s(x)  that  is  symmetric,  unlmodal, 
and  continuous  with  finite  absolute  third  moment.  Then,  for  c  in 
the  interior  of  the  support  of  s(x),  fc(x)  -  s(x)//*  s(t)dt,  x  >  c, 
the  conditional  density  of  X  given  that  X  >  c,  has  positive  third 
central  moment. 

Proof .  Suppose  that  Y  has  density  f.  Let  EY  -  y  >  0.  It  is  easy 

Y  c 

to  see  that  c  <  y,  so  that  we  may  define  Z  ■  (—  -  1)/(1  -  — ) . 

Ze  [l,00),  and  the  density  of  Z,  g(z),  has  the  same  shape  as  f  does. 

3 

Also,  “  0;  thus,  it  suffices  to  show  that  EZ  >,0.  When  c  ^  0, 
the  mode  of  g  is  at  -1;  when  c  <  0,  the  mode  of  g  is  at 
-  e  (-1,0) .  Now 
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EZ3  -  E(Z3-Z) 


(z  -z)g(z)dz 


j  +  f  +  j"  ■  |  (23-2)Cg(z)-g(-2))dz  +  |°°  (z3-z)g(z)dz  . 


The  second  term  above  Is  obviously  positive.  The  first  term  is  also 
3 

positive  because  z  -z  <  0  and  g(z)  <  g(-z),  since  the  mode  of  g 

3 

is  strictly  negative.  Thus  EZ  >.  0* 

Note:  It  is  in  fact  true  that  the  support  of  g  must  include  points 
in  (1,°»).  Also,  the  conditions  of  the  lemma  are  not  very  general,  but 
they  are  enough  for  our  purposes. 

Let  T  *  $  The  multivariate  Mills'  ratio  is 


R(c,T) 


Pj(X1>c . xn>c> 

4* (c  »c , . . .  ,c ; $ ) 


Steck  considers  the  more  general  {X^c^,  Vi};  we  specialize  to  c^  =  c. 
Most  of  our  results  apply  to  the  general  case  too.  Savage  [24]  suggests 
one  and  Steck  [30]  suggests  three  lower  bounds  to  R(c,T).  Savage  shows 
that 

R(c,T) «  |  exp(-cu'Te -y  u'Tu)du  , 

uj>  0 

where  e  -  (1,...,1)'.  Write  A  ■  cTe  and  assume  >  0,  he  shows 
that 


R(C’T)  -  (1  “  J  Cii/Ai  ”  j  Cij/AiAj 


n 

)/n  a. 
1  3 


Steck  shows  in  some  numerical  studies,  however,  that  Savage's  condition. 
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A^  >  0,  Is  too  restrictive  and  that  even  when  it  applies  the  resulting 
lower  bound  is  usually  bad. 

All  of  Steck's  suggestions  involve  a  likelihood  retlo  ergueent.  By 

an  appropriate  change  of  variables,  he  writes  R(c,T)  ■  Eg(V) ,  where 

V  is  a  random  vector  whose  joint  density  is  some  product  of  unlverlate 

2 

Mills'  ratio  densities:  exp(-xt-t  /2)/R(x).  Then  he  uses  the  approxi¬ 
mation  Eg(V)  «  g(EF) .  When  g  is  convex,  the  approximation  is  a  lower 
bound;  in  two  cases,  Steck  was  able  to  prove  that  this  was  Indeed  so. 

They  are: 

(i)  R(c,T)  >  ^  =  nj  (RCz^/Zt^  exp(-M’(Q-I)M/2)  . 

<il>  R(C,T)  >  S3  -  (|)”/2I^1/^  „(-J?  ^  Oy)  . 

However,  in  numerical  examples,  it  turned  out  that  his  other  approximation, 
R2>  yielded  the  best  (largest)  lower  bound,  so  he  conjectured,  but  did 

A 

not  prove,  that  E,^  was  indeed  a  lower  bound. 

A 

Our  work  consists  of  providing  a  sufficient  condition  for  R^  to 
be  a  lower  bound.  Using 


R(c 


,T)  ■  I  exp(-cu'Te --5- u'Tu)du  , 
Ju>0  £ 


and  making  the  change  of  variables  u^  “  v^  //qi.  we  have 


n  -1/2  f  1  °  "*iVi”Vi^ 

R(c,T)  -  (n  t.t/Z)  exp(-  4  v'(Q-I)v)  He  11  1  dv 

1  11  Jv>0  1  1 


where  Q  -  (ty/Zt^^t^)  and  ■  A^/fc^  .  Sow  y  v'(Q-I)v  *  Z  v^v^q^ 


i<j 
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we  combine  exponents,  we  get 


—1/2  2  9 

(II  ci±'  )exp(-v1{z1  +  Z  Vjq1j}-v1/2)exp(-v2(z2  +  2  y  q_2  }-v2/2)  •  •  • 
12  3 

e*P(-Vl{Vl  +  vn^-l,n}-vll/2)atP(^n*n'Vn/2)  * 
t2 

Now  recall  that  exp(-xt  — j)/R(x)  is  a  density.  Thus  multiplying 
and  dividing  by  a  product  of  such  factors,  we  can  write 

n  -1/2  n  n 

R<C-r)  '  <f  C11  +  \  VJ’lJ>!,<I2  +  §  Vjq2j)-*(Vi«nVi  ,,)»(.„) 


where  (V^,...,^)'  has  the  density 


f(v  , ...,v ) 
x  n 


exp(-v1  {z, +Z  v.q,  .}-vf/2  ,  2... 

1  1  ,  3  1  1  exp(-vz-W2) 

- £ -  ...  _ **  °  n 

n  R(z) 

R(z.  +  Z  v  q. .) 


R2  is  then  just  gotten  by  replacing  in  the  expression  above  by 

n 

+  2  V^q^)  beginning  with  V2  and  proceeding  with 

^  n  _  n 

Then  -  H  R(Wj)//t~  ,  where  wn  -  z^,  and  * 

1  k»i+l 

for  1  ■  n-l,n-2, . . . ,1.  Having  defined  R^  we  now  study  it  more  closely. 

n 

Define  h(v2,...,vn)  -  +  I  v^)  ...  ^Vl  +  Vl.nV11^’ 

so  that  R(c,T)  -  (II  t”J/2)E(h(V2,...,Vn)}. 
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Lemma  3.3:  h  is  a  convex  function. 

Proof .  It  is  well  known  that  h  is  convex  whenever  log  h  is  convex. 
Using  the  notation  that  we  developed  earlier,  we  will  show  that  the 
Hessian  of  log  h  is  non-negative  definite.  For  the  case  n  ■  4  it 
is  easy  to  show  that  the  Hessian  is  a  weighted  sub  of  the  following  three 
non-negative  matrices: 


12q13  q12q14l 

l 

’  0 

0  0  | 

0 

0 

#1 

2  | 

13  q13q14| 

j 

,  0 

1 

1 

2  1 

q23  q23q24  j  * 

0 

0 

0  ' 

1 

4 

2  i 

ql4  i 

i  0 

1 

2  l 

q24  ) 

0 

0  I34J 

A  A 

with  positive  weights  -y'^  +  Z^  v^q^) ,  -y'(z2  +  £3  vjq2j^’  and 
-y '(z3+q34v4> »  respectively.  Thus,  the  Hessian  is  positive  definite. 
The  proof  for  other  n  is  analogous.  QED 


Thus,  by  Jensen's  inequality,  we  have  that 


n  -1/2  n  -1/2 
R(c,T)  -  <11  t±J/  )Eh(V2,...,Vn)  >  (H  t^  )h(EVz,, 


•'CTn> 


Unfortunately,  the  right  hand  side  above  is  not  R2.  To  see  the  dif¬ 
ference  consider  the  case  n  ■  3.  Here  EV3  “  y(z^)  and  EV2  ■  EE(V2|V3) 
-  ^i(*24q23V3)  _>  y(z2+q23y(s3>).  We  get  the  last  inequality  here  because 
by  the  earlier  lemma  on  skewness,  y"  >0,  so  that  y  is  convax.  Thus 
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Since  R  is  a  strictly  decreasing  function,  we  can  say  that  if  q12  £  0, 
then  R(c,T)  £  R^  But  q^2  £  0  if  and  only  if  t^2  £  0.  Since  T  can 
be  replaced  by  irTir'  where  it  is  any  parnutatlon  matrix,  we  have  in  the 
three-dimensional  case  that  if  contains  at  least  one  negative 

off-diagonal  term.  Applying  the  same  technique  for  larger  n,  we  have 

Theorem  3.2:  If  has  at  most  (n-1)  positive  off-diagonal  terms, 

A 

then  R(c,T)  R^ 

We  omit  the  proof,  since  it  is  analogous  to  the  discussion  above. 
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CHAPTER  IV 


RESULTS  FOR  THE  EQUI CORRELATION  CASE 


Recall  that  whan  $  la  an  equicor relation  matrix  with  p  >.  0t 


(n) 

■ 


0 


L+SflMsfr 


<Kt)dt 


For  c  •  0,  we  have 


n 

<f>(t)dt  ; 


It  Is  well  known  that  p^  “  J  ~  C08  lp  and  p3^  “Y”  008  ^p  J  £P  £  I) » 

for  n  >_  4,  however,  cannot  be  expressed  in  terms  of  elementary  func¬ 

tions  (David  [6],  p.  34).  In  fact,  we  show  In  Theorem  4.4  that  for  n  >_  4 
p^n^  Is  everywhere  convex  in  p,  but  that  for  n  3,  it  is  convex  for 
p  >  0  and  concave  for  p  £  0. 

4.1.  The  Exceedance  Distribution. 

When  c  ■  0  and  p  ■  1/2.  we  have  p£n^  »  l/(n+l),  independent  of  k. 
This  is  most  easy  to  see  if  we  write  ■  A/2  Z ^  -  A/2  Zq  and  notice 
that  p£n^  is  just  the  probability  that  Zq  is  the  (n-k+1)  at  order 
statistic  in  the  iid  sample  (Zg,...,Zn).  It  is  clear  now  that  the  Z^ 
need  not  be  normal  for  the  exceedance  distribution  to  be  uniform.  This 
lad  us  to  consider  other  cases  for  which  the  exceedance  distribution  could 
be  computed  by  combinatorial  methods;  we  discuss  these  in  Chapter  5. 

Notice  also  that  we  can  write 
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(»)  r  *(t)dt 

*  /I^p 

(?)  I  (-1)1(J)  f  *(~^)n  k+i  ♦(t)dt 

i-0  1  Loo  /\Z^ 

(k*  J0(_1)  <1*  P{Xn-k+i,n-k+i  -  cJ 


where  X  is  the  ith  order  statistic  in  a  sample  of  size  n.  Thus  if 
ltn 

we  know  for  k  -  0,1,..., n,  then  we  can  compute  p£^  for 

k  -  0,1 . j  and  j  -  l,...,n.  This  is  similar  to  some  recursion 

relations  given  in  David  [6] .  It  can  be  argued  similarly  that  p£n^ 

is  expressible  in  terms  of  p^  for  J  -  1,2 . .  (for  arbitrary  $) 

by  using  the  inclusion-exclusion  formula.  However,  this  does  not  turn 
out  to  be  very  useful  computationally  because  repeated  additions  and 
subtractions  of  the  estimates  of  Pq^  typically  accumulates  too  much 
roundoff  error. 

Earlier,  we  generalized  the  equlcorrelation  case  to  the  single- 

factor  case.  He  can  generalize  in  another  direction  by  writing  the  lid 

N(0,1)  variates  (Z......Z  )  as  <Z.,...,Z  .Z  . . Z  .  ,...,Z  ) 

1  “  J.  nj+i  nl™2  n 

where  n  -  We  add  a  separate  main  effect  to  each  of  the  b  blocks 

to  get  correlation  matrices  that  look  like  this: 


a. 


l.  pb 


In  this  cade  we  have 


(n)  r  b  n.  r  !  r'+t-'pTl  Vki 

p‘  1 ;  <3  L*l-  -;*=)  fe)  *(t)dc  • 


-where  the  summation  la  over  {(k^  . . .  ,k^)  :  k^  ■  k  and  0  £  k^  £  n^}  . 

This  case  and  the  factor  model  case  have  been  very  Important  in  our  work. 
They  provide  a  large  class  of  correlation  matrices  for  which  we  can 
efficiently  (i.e.,  without  simulation)  compute  the  exceedance  probabilities. 
In  fact,  we  conjectured  the  variance  inequality  of  Chapter  3  after  looking 
at  many  specific  examples. 


Recall 


that  Sn  ■  Z°  l{X^>c}.  For  large  n  we 


Theorem  4.1: 


S_ 

P{—  <  x}  -*■  « 


,  o  <  x  <  1 , 


so  that 


Proof.  The  strong  law  of  largs  nun bars  says 


Thus, 


S  r  S 

P(~  <  *>  -  j  P("~  <  x|zo«t)$(t)dt 


|  P(i  X  I{Z£  >  <  x)<fr(t)dt 

f  <  x>4>(t>dt 

j  Sl^  ~ 

c  +  Zr/P 

P{l-4( — - — — )  <  x} 

S^P 

p{zn  >  -  —  t.  v^rP...^T„(x?  } 

0  Sp 


.-l. 


OfrCfft-P.-Q  <»>) 

Sp 


QED 


Ue  thus  have  a  two-parameter  family  of  distributions  on  [0,1]; 

F  .(*)  ■  $(a+W-1(x)),  a  e  TR,  b  >  0.  The  density  is 
a,o 

f  ,(x)  ■  b4>(a+M~1(x))/<J>(t~'*‘(x)) .  We  now  state  a  few  elementary  facts 
a,  □ 

about  this  family. 

(i)  a  ■  0,  b  ■  lowe  have  a  uniform  distribution,  which  is  con¬ 
sistent  with  the  discrete  uniform  result  for  c  ■  0,  p  ■  1/2. 

(11)  b-l,a>0(a<0)<+  the  density  decreases  (Increases)  from 

<*>  to  0  (0  to  '»)  as  x  goes  from  0  to  1. 
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(ill)  b  >  1  +  the  density  is  bounded  with  f (0)  “  f(l)  ■  0,  end 
It  is  unlmodal  with  nods  st  x  -  $(ab/(b2-l)) . 

(iv)  b  <  1  -sf(0)  »  f(l)  “  <»,  end  the  density  Is  u-shaped  with  a 
■in lawn  at  x  -  $(ab/(b2-l)) . 

These  properties  are  quite  slnllar  to  those  of  the  beta  distribution. 

Now  if  L  has  distribution  F  .  ,  then  its  momenta  are 

a,b 

ELQ  -  n  f1  t^d-F  K(t))dt 

J0  **b 

*  1  •  nP(Z^  ^  Zq, ^2  ^  Zqi  ...  ^  ZQ,Zn  a+bZg)  . 


So,  in  particular,  EL 


(«  $(-c)  In  the  theorem  above). 


There  seem  to  be  no  closed-fora  expressslons  for  the  higher  moments. 

It  Is  of  interest  to  know  when  the  approximation  to  the  exceedance 
distribution  by  the  limit  distribution  $(a+$  *(b))  (with  appropriate 
a,b)  is  good.  Numerical  examples  with  and  without  continuity  correction 
indicate  the  following. 

(1)  n  ^  15  often  yields  good  approximations. 

(11)  The  approximation  with  continuity  correction  is  better  than 
without  it  for  k  not  too  close  to  n. 

(11)  Both  approximations  are  quite  bed  for  p^  and  p^  when 
c  is  large.  Typically,  the  approximation  for  pg&^  is  too  small  and 
the  approximation  for  p^  is  too  large. 

Table  1  below  gives  some  examples.  The  exact  probabilities  are 


compared  with  approximations  with  and  without  continuity  correction 
The  values  of  c,  p,  and  n  are  Indicated. 


Table  1 


c  -  1.280  rho  -  0.250 


i 

exact 

with 

without 

prob. 

cont. 

cont. 

corr. 

corr. 

0 

0.314 

0.202 

0.000 

1 

0.229 

0.325 

0.386 

2 

0.154 

0.188 

0.247 

3 

0.103 

0.112 

0.145 

4 

0.068 

0.068 

0.087 

5 

0.046 

0.042 

0.053 

6 

0.030 

0.026 

0.033 

7 

0.020 

0.016 

0.020 

8 

0.013 

0.010 

0.012 

9 

0.009 

0.006 

0.007 

10 

0.005 

0.003 

0.004 

11 

0.003 

0.002 

0.002 

12 

0.002 

0.001 

0.001 

13 

0.001 

0.001 

0.001 

14 

0.001 

0.000 

0.000 

15 

0.000 

0.000 

0.000 

16 

0.000 

0.000 

0.000 

17 

0.000 

0.000 

0.000 

18 

0.000 

0.000 

0.000 

19 

0.000 

0.000 

0.000 

20 

0.000 

0.000 

0.000 

c  - 

0.000 

rho  ■  0.600 

i 

exact 

with 

without 

prob. 

cont. 

cont. 

corr. 

corr. 

0 

;).149 

0.105 

0.000 

1 

0.110 

0.129 

0.174 

2 

0.100 

0.110 

0.117 

3 

0.095 

0.104 

0.106 

4 

0.092 

0.102 

0.103 

5 

0.095 

0.104 

0.103 

6 

0.100 

0.110 

0.106 

7 

0.110 

0.129 

0.117 

8 

0.149 

0.105 

0.174 

c  -  0.000  rho  -  0.333 


1  exact  with  without 

prob .  cont .  cont . 

corr .  corr . 

0  0.044  0.010  0.000 

1  0.074  0.061  0.035 

2  0.095  0.099  0.082 

3  0.109  0.123  0.112 

4  0.118  0.137  0.131 

5  0.121  0.141  0.140 

6  0.118  0.137  0.140 

7  0.109  0.123  0.131 

8  0.095  0.099  0.112 

9  0.074  0.061  0.082 

10  0.044  0.010  0.036 


c  -  0.850  rho  -  0.400 


i 

exact 

with 

without 

prob. 

cont. 

cont. 

corr. 

corr. 

0 

0.260 

0.183 

0.000 

1 

0.177 

0.227 

0.310 

2 

0.130 

0.152 

0.183 

3 

0.100 

0.111 

0.129 

4 

0.078 

0.084 

0.096 

5 

0.064 

0.064 

0.073 

6 

0.050 

0.050 

0.056 

7 

0.038 

0.038 

0.043 

8 

0.029 

0.029 

0.033 

9 

0.022 

0.022 

0.025 

10 

0.016 

0.016 

0.018 

11 

0.011 

0.011 

0.013 

12 

0.007 

0.007 

0.0U9 

13 

0.004 

0.004 

0.005 

14 

0.002 

0.002 

0.003 

15 

0.000 

0.000 

0.001 
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We  saw  above  that  for  c  ■  0,  and  p  ■  0,  the  exceedance  distri¬ 
bution  is  binomial;  for  p  ■  1/2,  it  is  uniform;  and  for  p  -  1,  it 
has  point  masses  of  1/2  each  at  0  and  n.  As  p  tends  from  0  to 
1,  we  go  smoothly  from  a  bell-shape  to  a  u-shape;  the  proof  of  this 
Intuitively  obvious  fact  is  surprisingly  hard.  The  following  lemon 
makes  this  fact  precise.  Since  the  proof  does  not  require  the  assumption 
of  normality,  we  state  it  in  some  generality. 

Lemma  4.1;  Suppose  4  is  any  distribution  function  with  $(-x)  "  l-$(x) . 
Let  4'  -  $  be  such  that  L(x,£)  ■  <K^)/<Kx)  is  decreasing  in  |x| 

for  0  <  £  £  1  and  increasing  in  |x|  for  1  £  £  <  <®  .  Then  for 
0  <  p  <  1/2  the  exceedance  distribution  satisfies 


1  P 


(n)  > 

[n/2]  - 


for  y  <  p  <  1,  the  inequalities  above  are  reversed. 

Proof.  The  condition  on  L(x,£)  is  a  monotone  likelihood  ratio  type 
of  restriction.  It  is  satisfied  by  the  normal  and  Cauchy,  for  example. 
We  first  show  that  for  0  £  p  £  1/2,  p^  and  that  for 

2  <  k  <  pk  _  pk_x.  Now,  for  £  -/p/( 1-p) , 


Pl“P0 


r 

J  —00 

r 

•>0 


j"  *<-£t)*(£t)n~Vt)dt  -  j"  *(£t)n<j»(t)dt 

(n»(t)n"1-(n+l)*(t)n)L(t,£)^(t)dt 
(f(*(t))  +f(*(-t)))L(t,£H(t)dt 
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where 


f(y)  ■  nyn"^(n+l)  yn.  f  has  roots  at  0  and  — also, 
g(y)  *  f(y)  +  f  (1-y)  Is  strictly  decreasing  for  — jj-  £  y  £  1.  g 
Is  strictly  positive  in  (-j,  — j^]  and  g(l)  *  -1,  so  there  is  a 
unique  y*e  (~j-,l)  such  that  g(y*)  ■  0.  Now  suppose  0(t*)  *-  y*. 
Then 


™  '  l 


g(*<t))L(t,0*(t)dt 


-  f  t  g(*(t))L(t,C)«Kt)dt  +  r  g(<f(t))L(t,?)4>(t)dt 

J0  Jt* 

>  Utsocf  g(4(t))4»(t)dt  +  f  g(*(t))<Kt)dt 
J0 

-  LCt*,C)  f  g<*(t))<Kt>dt  -  0  . 

Jn 


Thn.  above  inequality  >.  1®  f°r  0  £  p  £  j;  for  y  £  p  £  1  we  get  £  . 

We  get  the  last  equality  above  because  for  P  *  j  (so  that  £  ■  1), 
p .  ■  Pq.  We  are  thus  done  for  p^  and  pQ.  Notice  that  we  have  used 
the  likelihood  ratio  (L(t,£)  is  one  ) technique  that  is  so  conmon  in 
random  walk  theory  —  we  transfer  our  attention  from  C  ^  1  to  £  »  1, 
where  matters  are  simple  since  then  p^  -  *  *  *  "  PQ  "  The  proof 

for  pk+i  >  pk,  for  k  >  2,  2k-l  £  n,  0  £  p  £  ~  is  similar,  but  the 
function  g  is  no  longer  as  simple  as  above,  ft^w 


pk”pk-l 


(J)  j  *C-5t)k«(Ct)n'k<Kt)dt-(k“1)  j  *(-£t)k"1$(£t)n~k<KOdt 
(J>  g(«<t))L(t,£)$<t)dt 
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where  f(y)  -  (1-y)  “  yn~  (1  -  y)  and  g(y)  «  f(y)  +  f(l~y)  is 


defined  for  ye  [j,!].  f  has  roots  at  0,  1 


n-k+1 


;  f '  has  critical 


points  at  -  - 


/fed 

n-k+1  +  y  n  ' 


.  Thus,  f  looks  roughly  like  this: 


We  will  be  done  if  we  can  show  that  g  has  a  unique  root  y*  in 

1)  ,  that  g  is  positive  in  [y,  y*)  and  negative  otherwise;  for 
then  we  can  use  the  same  proof  as  above.  Now  g  is  strictly  positive 

/lt(l  _£~i) 

,1  n-k+1.  .  ...  ,n-k+l  n-k+1  ,  n  , 

in  ^’'S+T1  and  strictly  decreasing  in  ,  “ST"  + - iST"3  ‘ 


h(  1  -  ~“) 


We  will  be  done  if  we  can  show  that  for  y  e  + - H » 

g(y)  £  0.  Por  y  -  1,  this  is  trivial;  so  suppose  y  +  1.  Note  that 
g(y)  £  0  <-> 


(l-y)n"k(l  -  y)  +  yk_1(l-y)n"k(l  -  (l-y))<  0 


<—>  (/  ■) 
1-y 


n-2k+l 


>  1  + 


n-2k+l 

(n+l)y  -  (n-k+l!)  * 


Since  n  2k-l,  it  suffices  to  check  g(y)  0  for  ye  1). 


n-2k+l  n_k+1  +  fi~P[  n-2kfl 

In  this  range,  (,“)  >  (“ - - - )  ,  since  this  function  is 

x-y  -  k-^72 

strictly  decreasing  in  y.  So  now  it  is  enough  to  show  that 


n-2k+l 


,  .  n-2k+l  _  ,n-k+l  +  /k/2,  .  „  „  .  „ 

1  + - <  ( - 1 — )  f  or  k  *  2 , 3 , . . .  and  n  >  2k-l .  The 

Vk72  '  k-  /k?2 

inequality  is  trivial  for  n  -  2k-l,  2k,  and  2kfl.  Finally,  if  we  let 
n-2k+l  *  j ,  we  note  that  the  functions  1  +  -  -  -  and  (Xjfe_+yk/2^ 


/k/2  k  -  /k/2 

are  to  be  compared.  It  is  rather  easy  to  see  that  the  latter  dominates 

the  former  for  all  x  ^  0.  Thus  we  have  our  desired  inequality  so  that 

g  has  a  unique  root  in  [-fk  1),  and  we  are  done.  _ 

L  Q£l) 

The  condition  on  L(t,£)  *  4>(^)  /4>(t)  above  eliminates  densities 

that  look  like  this: 


It  is  a  somewhat  puzzling  condition.  We  suspect  that  the  result  is  true 
without  it,  but  have  not  been  able  to  show  that. 

Now  we  come  to  an  interesting  result  that  is  fairly  easy  to  prove 
given  the  lemma  above. 

Theorem  4.2:  Let  p(p)  -  (p£n) (p) , . . . ,p£n) (p)) .  If  0  <  p1  <  p£  <  ~  , 
then  p(px)  >  p(p2);  if  J  1  PL  <  P2  <  then  ptpj)  <  p(p2> .  Here, 

*  K  y  means  that  y  majorizes  x  in  the  sense  of  Marshall  and  Olkin 
[16]. 
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Proof.  Assume  that  n  -  2m+l  is  odd;  the  proof  for  even  n  Is  similar. 
Here  p£n)(p)  -  P^ll-i^  since  c  “  0j  al8°» 

P<n)(P)  <  pjn>(p)  <  •••  <  P^n)<P)  "  p£i<P>  l  —  z  P^li<P> 


for  0  <  p  <  Y  and 


pjn)(p)  >  P^(P)  >  •“  >  P^(P)  *  P^<P)  1  •**  1  p2^1(p)  * 


Thus,  it  suffices  to  show  that  p^(p),  2p^(p),  2p^(p)  +  p^n?(p), 

m  m  m  m— x 

2p(n)(p)  +  2p^(p),  2p<n)<p)  +  2p<n>(p)  +  p<n>(p),...  etc.  all 
m  tu— x  m  in— x  m— c 

decrease  in  p  and  that  p£n^(p),  2p^  (p) ,  2p^  (p)  +p^(p),...  all 

decrease  in  p  .  Since  E®  p^  (p)  =  1/2,  it  suffices  to  show  that 

pfn)(p),  2p(n)(p),  2p^n)(p)  +  pf“^(p),...  etc.  are  decreasing.  To 
in  tn  m  m— x 

do  this,  we  just  show  that  all  the  derivatives  are  negative;  the  details 
are  a  bit  messy  but  straightforward.  Let  £  *  i/p/ (1-p)  (£  is  a  strictly 

increasing  function  of  p) .  So,  for  j  <  m 


-  {  Pm  ,(P)  -  1  (2“tl)  f  *(£t)m+i+1  c|>(t)dt 

i»0  m-1  JmO  '  _00 

-Oi  crif&r ♦< 


*<£t)"rt'i+i  *<t)dt 
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r<o  ■  O  £  (I  •««-1  *«'>*“ 

.  I  ml^j|  —  *(-5t)“"i_1  $(St)“fl+1}  4>(t)t<KCt)dt 

%  (m-i)  !  (m+i)  ! 


(2m+1)m!  (mfl) 
m 


-  Jf  }  t  „(t)  *(5t)dt 

v  (m-k)  !  (m+k)  I 


:f  <* 

Jo  0 


a-i*/ 


(m-i)  I  (m+i)  I 


.m-kA/r^a+k 


ffi“k*/  \  m+k 


,2m+l.  ml 
m  (m+j+1) 


<  0  . 


-lTr  f  (t(-Ct)$(5t))m‘j’1  {*(Ct)2J+2-*(-Ct)2J+2> 
l)t(m-j-l)!  J0 


t4>(t)<KCt)dt 


In  f'(0  above,  the  second  equality  is  derived  thus:  if  h  is  an  odd 
function  then 


g(x)h(x)dx 


r 

Jo 


(g(x)-g(-x))h(x)dx 


above  t$(t)4>(5t)  plays  the  role  of  h.  We  then  get  a  collapsing  sum 
which  yields  the  third  equality  there.  We  thus  have  that 


l  p  (p)  (and  so  2  \  p  «(p)) 
0  m_i  0  m  1 


is  decreasing  in  p  for  j  <  m;  the  case  j  ■  m  is  trivial  for 


m 


l 

0 


“m-i 


(P)  =  \ 
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»' j»«*J  ’flwyrtW'Tf# 


Similar  but  tedious  algebra  shows  the  result  for 

2 1  Vi<p)  +  Vj-I(p)  • 

So  our  proof  for  0  £  p  £  Is  complete.  The  proof  for  j  £  p  <  1 
follows  from  the  fact  that 

l  Vi<»>  2 1  ■ 

QED 

Notice  that  the  proof  is  heavily  dependent  upon  the  symmetry  Induced 
by  letting  c  -  Oj  this  tells  us  that  the  mode  of  the  exceedance  distri¬ 
bution  is  at  [n/2] .  An  annoying  feature  of  trying  to  prove  majorizatlon 
results  here  seems  to  be  that  we  must  know  the  location  of  the  mode. 

Ve  have  not  yet  extended  this  result  to  c  0.  Numerical  evidence 
tells  us  that  we  do  not  have  majorizatlon  for  all  c;  but  p(p,c)  (viewed 
now  as  a  function  of  p  and  c)  is  a  smooth  function,  so  we  should  get 
a  majorizatlon  for  some  c  i  0.  In  particular,  we  expect  to  find  an 
interval  of  c’s  for  which  majorizatlon  still  holds. 

4.2.  Orthant  Probabilities  for  the  Equicorr elation  Case. 

In  the  last  chapter,  we  studied  P  (X  >c,  Y  >c)  in  connection  with 
the  exceedance  distribution.  Here,  we  study  the  analogous  function  for 
n  >  3.* 


* 

We  arrived  at  results  in  this  section  when  we  tried  to  answer  a  query 
by  Professor  Olkin. 


41 


■WWVy- 


Theorem  4.3:  For  all  n,  and  each  fixed  c  >  0,  f  (p)  -  P_(X,  >  c,...,X_  >  c) 
— — — —  —  c  pi.  n 

la  a  strictly  convex  function  of  p  In  (0,1).  For  each  fixed  c  >  Jl  -1 

and  all  n,  f  (p)  la  strictly  convex  for  all  pe  ( - ,  1). 

c  n-x 

proof .  The  key  fact  involved  in  this  proof  is  Plackett's  Identity: 


We  write  $j.(x)  for  <j>(x;$)  •  Now  fc<p)  *  /£  ^  (x)(dx)n»  where 
(dx)n  »  nj  dx^.  Using  the  chain  rule  and  Plackett's  Identity,  we  get 


E>>  •  [  dp  '  J  j  £  3^  TP1  <dl>» 


l  f  5T5T 

i<j  Jc  3V  j 


<J>*  (x)(dx) 


"xn-2’c’c)(dx)n-2 

^  (Xl* • • • *xn_2*^’^^ 

~B  ^  (c,c)  <dx)n-2  * 


Henceforth,  a  zero-dimensional  integral  is  defined  to  be  1:  that  is, 

/  cfs^(x)(dx)0  ■  1.  Now  the  integrand  is  the  conditional  density  of 

h . Xn-2  given  Xn-l"Xn“c‘  NoW  (X1’ *  *  * ’Xn-2lXn-l  ’  Xn"  c) 

the  same  distribution  as  x,  where  e’  -  (1 . 1), 

J  *  e®'»  tpm  I  +  J+Zp  J  X  is  a  N(0,$p)  variate.  Notice 

th“  “  -  <  0  <  th*>  -  <  rife  <  T  • 
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‘*&********z"*?  >****•  mv* •*  'v*r*  +>  nap,  rranye^youa^WMat^  ^i,*n‘>|i^»g|i1wiiiSWP^W^ 


f'(p)  -  (P  $+  Cc.c)  [  ♦£  (x)(dx) 

'cate)  *p 


where  a(p)  -  . 


Next, 


fc<P> 


$  35  ♦*„«•'>  L(p,  ♦f0W(ta>»-i 

<“>  v-*  ((£? + i?  L,  v0'*0-* 


5L.*iwH,» 


1  ca(p)  *p 

To  evaluate  the  last  term  above,  we  use  a  simple  extension  of  Leibnitz's 
rule.  Recall  that 


r  h(p,x)dx  -  r 

dp  iu(p)  iu(p)  3p 


h(p,x)dx-  h(p,u(p))u'(p) 


We  can  use  induction  to  show  that 


dp  J  ,  .  ***  J  ,  .  h(p,xl . xn)dV  ••,,d*n  " 

•'u(p)  ;u(p) 

j  •••  j  h(p,x1,...,xii)dx1,...,dxn  - 

'u(p)  ■'u(p)  y 

I  u'(p)  [  ...  |  h(p,x.,...,u(p),...,x  )(dx) 

1-1  'u(o)  'u(p)  l 


'u(p)  -'u(p) 

where  u(p)  replaces  x±  in  the  last  Integral.  Thus 
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*c<P>  -  C2 


(c,c)  {[(^)2 + c-S)]  r 


(1+2P) 


)4>x  (c,c)  {[(yrr)  +  C-^)]  [  <f>?  (x)  (dx)  , 

*p  l+p  1-P2  J  c(p)  +p  n“2 

“ — o  C11,2)  I  (x. . .  ,,ca(p),ca(p))(dx) 

•2o>  2  'ca(p)  *p  1  n_A 


n-4 


r 


-  c(n-2)a‘(p)  <x.,...,x  «,ca(p))(dx)  J  . 

Jca(p)  *p  1  n~3  0-3 


The  last  two  integrals  are  proportional  to  certain  conditional  probabilities, 


so 


-  <>}  ♦  -fy  f  ,  *i  «(«».: 

Tp  K  1-p  ;ca(p)  *p 

+ - (ca(p).ca(p))  f  <frf*(x)(dx) 

<l-2p)2  2  *p  Jcb(p)  +p  n~ 

+  (n-2)  <$'(ca(p))  f°  <fif.**(x)(dx)  } 

8(P)  icd(p)  +p  n"3 


-  (”)  <!>}.  (c,c)  {i  +  ii  +  in} 


*S  ■ (1  -  xS*>1  +  <n4p)J'  V  « -  ifip*1  * 

$p  "  ^  “  i43p~) 1  +  ^i+3p^J  ar*  of  th®  *PPfopri«t«  dimension;  b(p), 
d(p)  are  rather  messy  and  not  important  for  our  purposes,  so  va  omit 

them;  and  a(p)  •  .  notice  that  for  p  >  -  a(p)  >  0 

and  -  -  ( — <  °»  Notice  further  that  II  la  always 

positive;  III  is  positive  for  c  >  0  and  p>-  ~;  and  I  la  positive 

for  either  (1)  p  ^  0  or  (11)  |c|  >  /2  - 1  and  all  p.  Thus  we  have  some 

simple  sufficient  conditions  for  £"(p)  >  0,  and  the  theorms  is  proved.  QKD 

6 
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We  have  not  been  able  to  deecrlbe  what  happens  when  pe  (-  ~y ,  0) 
and  0  <  c  <  v'l  -1.  For  c  ■  0,  recall  that  p£^  m  ^~2tt  c0B"**P  an^ 
p^  ■  y-  cos  ^p,  and  that  for  n  4,  p^n^  cannot  be  expressed 
In  terns  of  elementary  functions.  The  following  theorem,  whose  proof 
Is  rather  delicate,  sheds  some  more  light  on  this  fact. 

Theorem  4.4:  For  n  ■  2  and  3,  fg(p)  “  Pp(X^ >  0, . . . ,Xq >  0)  Is  strictly 

concave  for  pe  ( - ^V,  0)  and  strictly  convex  for  pe(0,l).  For  n  >  4, 

n-i.  — 

fg(p)  Is  strictly  convex  for  all  p  e  (-  »  1)  • 


Proof.  For  o-2  oni  3,  fjj(p)  is  2?  '.Hh/i'  if  M~~2,T/2 

(1-P  )  (1-P  ) 

respectively,  which  are  strictly  negative  for  p  <  0.  For  n  »  4,  we 
have 


f^(p) 


*  (l+2p)/(l+p)(l+3p)  2tt  1-p 


+  -2-j  P~(X>  0,Y >  0) } 


where  corr(X,Y)  -  p  *  1+2^*  f°r  -  y  <  P  £  0,  the  first  term  is  at 

least  £  .159,  and  the  second  term  is,  in  absolute  value,  less  than 
3 

22  z.  *094.  Thus  f"  >  0  and  for  n  ■  4  f  is  strictly  convex  in  its 


entire  domain  (-  y,  1).  For  n  -  5,  f"(p)  ■ 


_3 

4ir 


M-P2  1_p 


{7Vp( V  °*  V  °’ V 


(l+2p)/(l+p)(l+3p) 


. p  1 

}  where  (X^^.Xj)’  'v  N(0,t~) .  For  -  -jr  <  p  £  0,  the 


second  term  exceeds  .238,  and  the  first  term  is,  in  absolute  value, 

less  than  yy  ^  >033.  Thus  f  is  again  convex  in  its  entire  domain  (-  |,1) . 
The  case  n  >  6  is  a  bit  more  Involved.  Here, 


t 


f"(p)  -  (?)  <V0 . xn-2>0)  + 


k2'  2ir 


/1-p 


2  1-p 


(n_2)  -i 

v  2  ;  2tr 


(l+2p)/(l+p)(l+2p) 


p D*<xl>  °»***»Xn-4>  °* 


where  p  -  3^  and  p*  -  p/(l+4p).  Notice  that  p  e  (-  ^3,  j)  and 

p*e  (_  -i— ,  i);  ve  only  need  consider  the  case  p  <  0,  p*  <  0  here. 

H  n-5  5 

Now  if  X'vN(O.k),  then  3^ . Xn_AlXn-3 " x*  Xn-2-y  *»*  th«  «“e 


distribution  as  e  +  T  where  T  N(0,t  *)  .  Thus 

1+p  ’  1+p 


Pp^l5,  0 . Xn-2>  05 


■  0  VV° . \-4 » °1  Jn-3‘3 •  Vz'*'1 \ <*  •y)d*'‘y 

-  O  Pp*CTl>0 . T»-*  >  0)^  (x.y)d*dy 


(since  p  <  0,  l+p>0,x+y  >  0) 


Vv° . W^'V-V05 


Thus,  since  p  <  0, 


f,,<P>  >  <!J>  £  -J=Z  Pp*<xi>° . Xn-4>0)  f  7^2  Pp(Xl>0*X2>0)  + 

/l-p2 


—  —  ■■■  ■  - 
2  2ff  (l+2p)/(l+p)(l+3p) 


•}  . 
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For  p  e  ( - ~,  0),  the  last  term  above  is  at  least  (n22)  jj”’  *  the  fir8t 

term,  in  absolute  value,  is  less  than  y  n(n_2) •  ea8y  to  8ee  t*'at 

for  n  >  2?  (tl22)*  ThU8  f"(p)  >  0  and  f  18  strictiy 

convex  in  (-  D  •  QED 
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CHAPTER  V 


MISCELLANEOUS  RESULTS 

5.1.  Series  Expansions. 

In  Chapter  2,  we  used  an  asymptotic  expansion  about  the  equicorr elation 

case  to  s how  that  the  $_  approximation  is  locally  optimal.  In  this 

P 

section,  we  use  an  expansion  about  the  identity  to  compute  the  exceedance 
probabilities.  We  will  see  that  (i)  the  coefficients  in  the  expansion  are 
hard  to  compute,  and  (il)  the  first  two  terms  of  the  series  are  good  only 
locally.  It  will  also  be  clear  that  using  the  expansion  about  other  equi¬ 
corr  elation  matrices  is  much  too  cumbersome  in  practice.  Earlier,  we  used 
Plackett's  identity  to  get  the  first  coefficient;  here,  differentiating 
directly  is  more  convenient  for  describing  the  coefficients. 

As  before,  consider 

p£n><0>  *  pt(9>  -  <2*>"n/2  f  lat+d-ejil^^expC-ix'tet+d-ejD^dx  . 
k  \(c)  2 

We  would  like  to  write 

A2 

pk<0)  -  pk(0)  +  0pk(O)  +|-  pk(0)  +  ...  ;  k  -  0,1,..., n  . 

If  we  write 

a(x)  -  x"1/2  ,  b(0)  -  |ej:-tfl|  ,  g(6)  -  a(b(0)) 
c(t)  -  e”t/2  ,  d(0)  -  I'Ce^D*1!  ,  h(0)  -  c(d(0)) 

(we  suppress  the  dependence  of  h  and  d  on  x) ,  than  Lelbnlts's  rule  says 
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Che  rth  derivative  of  Is 

l  g(i)(6)h<r_1)(0)dx  . 
1-0 


The  derivatives  of  the  composition  g(8)  -  a(b(0))  are  given  by  the 
formula  of  Faa  di  Bruno: 


(i) 


(0)  -  I 


i! 


ml! 


•m^l 


a“(b<0)) 


i 

n 

j-i 


.bOiu O 

(  y  > 


where  the  summation  is  taken  over  ^  0,  E  m^  -  m,  and  E  jm^  -  i  — 

that  is,  over  all  partitions  of  i.  From  elementary  calculus,  we  know 

that  a^(l)  -  m'  (_1^2) «  Also,  if  {ot  }“  are  the  eigenvalues  of  (1-$), 

m  i  -L 

then 


u  - 

b(8)  -  det(0$4?I)  -  II  (l-Octj)  -  l-0Ul(a)  +8  u^(a)  +...+  (-l)n0nun(a) 

where  u^(a)  is  the  ith  elementary  symmetric  function  of  the  eigenvalues 

f cx  i 

i'i 


Ma)  «  J  a 
V,<ji  1 


.CJ), 


Then  —  j {  ^  =  (-l)^Uj(a)  and  we  get 


-1/2  n 


V>  n  -jW1  • 

n1,*~mi!  m  iml  1 

Also,  c(p)(t)  -  (-  y)P  e‘t/2  -  (- y)Pc(t)  and  d(i)(0)  -  ilx'd-J)1*, 
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so  that 
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We  can  take  j  of  the  x±'b  with  odd  exponents  and  put  them  in  the 
(n-k)  "negative  slots"  above:  there  are  (^)  ways  of  doing  that.  Of 
the  remaining  (n-p)  x^s  (which  have  even  exponents)  we  choose 
(n-k-j)  of  them  to  fill  the  remaining  negative  slots.  It  is  clear 
that  each  such  configuration  contributes 

*  .  n  p 

(-1)3  e  n  |  x.  |  1 

2  1 

to  the  integral  above,  so  we  get  the  result  by  just  adding  up  these 
contributions.  QED 

There  does  not  seem  to  be  a  corresponding  nice  result  for  the  integral 
above  when  c  i  0,  although  we  have  enough  expressions  to  evaluate  f^(0) 
and  f£(0).  for  c  *  0, 

(i)  <n  x.KT(x)dx  =  l  (-l)i(^)rt<l>(c)b$(-C)k"i$(c)n'k+i"b  , 

-\(c)  1  1  1  i 

(ii)  f  (n  x^T(x)dx  = 

(c)  1 

y  (b(""b$(-c)k‘i$(c)n"k+i"b(c«()(c)44(-c))i(-c(}.(c)-K>(c))b";L  , 

~  i  k-i 

and 

(iii>[  (x^x2x3)6I(x)dx  -  (-c<Kc)-H?(-c))  l  ( i> (kli> (-1) (c> 2$ (c) n‘k+i_3$ (-C) k-i 
\(c)  i 

+  (c-Mc)+0(~c))  J  (-l)i(J)(k“^1)<l>(c)20(c)n“k"2+1*(-c)k“1'1  . 
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If  we  ranted  to  expand  the  probabilities  about  other  equicorrela- 
tion  matrices,  the  coefficients  we  would  get  are  integrals  of  the  terms 
(i),  (ii),  (iii)  above. 

Appendix  2  contains  some  examples  of  the  use  of  expansions.  For 
comparison,  we  took  $  to  be  an  equicorrelation  matrix  with  p  -  .5, 
and  c  ■  0.  We  got  the  first  column  by  numerical  Integration,  and  the 
second  column  by  using  the  first  two  terms  of  the  expansion.  For 
0  ■  .02,  the  approximation  is  excellent,  as  might  be  expected.  However, 
for  0  ■  .6,  it  is  quite  bad  -  in  fact,  it  can  yield  negative  values! 


5.2.  Some  Combinatorial  Results. 

Recall  that  for  the  equicorrelation  case,  with  p  «  1/2  and  c  ■  0, 
the  exceedance  distribution  is  uniform  and  this  result  does  not  depend 
upon  the  fact  that  the  X^'s  are  normal  —  it  is  essentially  a  combina¬ 
torial  result.  This  led  us  to  seek  out  other  distribution-free  results 
via  combinatorics.  The  results  in  this  section  are  quite  limited  in  scope, 
but  they  are  Interesting  nevertheless.  Let  c  ■  0  in  this  section. 

Consider  (ZQ,Z^, . . . ,Zn)  iid;  if  *  ±Zi  ^ ±  Z^,  i  *  l,...,n, 
then  we  can  get  {p£n^}  by  counting  methods.  For  example,  if  X^*Zj-Z 
we  notice  that  (Z^,...,Zn)  is  a  random  permutation  of  the  order  statistics 

*Z(0),Z(l)’"*,Z(n)^  to  get 
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P(k  of  the  (Zj-Z^j)  are  positive) 


P((Zn,...,Z  )  has  k  positive  successive  differences) 
u  n 


P(a  random  permutation  of  (Z^ , . . . »z^nj)  has  k 
positive  successive  differences) 


■  P(a  random  permutation  of  {0,...,n}  has  k  positive 
successive  differences) 

*  *  *  where  {^}  satisfies  the  recurrence  relation 

{£)  =  kC11"1}  4-  (n-k+l){”-^)  with  boundary  conditions  {“}  -  1, 


{”}  are  called  Euler ian  numbers,  which  are  tabulated  in  David -Kendall-Barton 
[5]  for  n  £  15;  for  larger  n,  we  can  use  the  central  limit  theorem  for 
m-dependent  variates  to  say  that  this  distribution  is  asymptotically 

j^-) .  The  result,  of  course,  is  completely  distribution  free. 

The  next  result  requires  that  Z^  be  symmetric  about  zero.  Now 
suppose  ■  Zj,  +  Z^  i  ■  l,...,n.  Here  we  want  P{k  of  the  (Zj+Zj_^) 
are  positive}.  To  compute  this,  notice  that  Z^ + Z^  ^  are  arrived  at 
by  randomly  permuting  |  z|  ^  , . . . ,  |  z|  ^  —where  |z|^  is  the  i-th 
ordered  absolute  variate  —  and  then  independently  attaching  a  plus  or 
minus  sign  with  probability  1/2  each.  So  to  compute  the  probabilities, 
we  may  think  of  randomly  permuting  {0,l,...,n}  and  then  randomly  attach 
signs  to  get  what  we  call  a  "signed  permutation.”  The  probability  p£n^ 
is  the  number,  say  Tn+^  of  signed  permutations  that  contain  k 
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positive  successive  sums,  divided  by  2n+^(n+l) ! .  The  recursion  rela¬ 
tions  for  T  .  are  more  complicated  than  those  for  {?} : 

Q I K 


Tn+1,0 

Tn+l,l 

Tn+l,j 


<“+1)In,0  +  Tn,l 


Td,1  +  2Tn,2 

+  0+1)I„,  j-1 +  +  «+l,t,.J+l 

for  j  ■  2, . . . ,n-2 


T  ,  -  2T  ,  +nT  ,  +  2T  , 
n+l,n-l  n,n-3  n,n-2  n,n-l 

T  .  -  T  -  +  (0+1)1  .  , 

n+l,n  n,n-2  n,n-l 


with  the  boundary  conditions  ^  0  "  ^2  1  *  ^  and  Tn  n“Tn+i  n+l* 

It  is  interesting  to  note  that  *  an/(n+l)J  where  an  is  the  nth 

Euler  number  —  a3  ■  1,  a2  *  2,  a3  -  5,  a^  ■  16,  a5  -  61,  afe  -  272  •••  . 

Again  the  exceedance  distribution  is  asymptotically  N(n/2,  (n+l)/12). 

It  should  be  clear  now  that  if  we  have  a  tri-diagonal  £  with  only 
+  1/2  on  the  super-  and  sub-diagonals,  we  can  generate  {  by  appropriately 
choosing  signs  for  (±Z^ ±  Z^, . . . ,±Zq  ^ ±  Zr)  and  proceed  as  above. 

Another  situation  for  which  combinatorial  arguments  are  known  are  for 
t  with  ■  iAj  Vi, j.  This  $  is  generated  by  partial  suae  of  an 
lid  (Z1>1  process.  We  then  get  the  discrete  arcsine  distribution: 

p£n^  ■  ^)2~^n.  A  close  look  at  the  discussion  in  Feller  [8] 

shows  that  this  result  is  true  for  partial  sums  generated  by  exchangeable 
variates.  That  is,  if  (Z^,Z2>...)  is  exchangeable  with  cov(Z^,Z^)  •  p  >_0  , 
and  S  ■  I?  Z. ,  then  the  covariance  matrix  of  (S1,...,S_)  also  yields 
a  discrete  arcsine  lav. 
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Appendix  I 
Part  1. 


rho-0. 1  c-0.0  diag  -  3 


k 

phat 

error 

equl 

0 

0.075 

0.001 

0.075 

1 

0.251 

0.002 

0.249 

2 

0.350 

0.002 

0.351 

3 

0.248 

0.002 

0.249 

4 

0.076 

0.001 

0.075 

rho-0. 1  c-0.25 

diag  -  3 

k 

phat 

error 

equl 

0 

0.146 

0.001 

0.146 

1 

0.333 

0.002 

0.333 

2 

0.327 

0.002 

0.326 

3 

0.160 

0.001 

0.161 

4 

0.035 

0.001 

0.034 

rho-0 . 1  c-0 . 68 

diag  -  3 

k 

phat 

error 

equl 

0 

0.339 

0.002 

0,337 

1 

0.396 

0.002 

0.398 

2 

0.205 

0.002 

0,205 

3 

0.054 

0.001 

0.054 

4 

0.006 

0.000 

0.006 

rho-0  1  c-0 . 85 

diag  -  3 

k 

phat 

error 

equl 

0 

0.431 

0.002 

0.430 

1 

0.384 

0.002 

0.385 

2 

0.150 

0.001 

0.151 

3 

0.031 

0.001 

0.031 

4 

0.003 

0.000 

0.003 

rho-0. 1  c 

-1.28 

diag  -  3 

k 

phat 

error 

equl 

0 

0.665 

0.002 

0.663 

1 

0.277 

0.002 

0.278 

2 

0.052 

0.001 

0.053 

3 

0.006 

0.001 

0.005 

4 

0.000 

0.000 

0.000 

rho-0 . 1  c 

-1.96 

diag  -  3 

k 

phat 

error 

equl 

0 

0.906 

0.001 

0.905 

1 

0.090 

0.001 

0.090 

2 

0.005 

0.000 

0.005 

3 

0.000 

0.000 

0.000 

4 

0.000 

0.000 

0.000 

rho-0. 1  c-0.0  diag  -  2 


k 

phat 

error 

equl 

0 

0.075 

0.001 

0.075 

1 

0.251 

0.002 

0.249 

2 

0.350 

0.002 

0.351 

3 

0.248 

0.002 

0.249 

4 

0.076 

0.001 

0.075 

rho-0. 1  c-0.25 

diag  -  2 

k 

phat 

error 

equl 

0 

0.146 

0.001 

0.146 

1 

0.333 

0.002 

0.333 

2 

0.327 

0.002 

0.326 

3 

0.160 

0.001 

0.161 

4 

0.035 

0.001 

0.034 

rho- 

■0.1  c-0.68 

diag  -  2 

k 

phat 

error 

equl 

0 

0.339 

0.002 

0.337 

1 

0.396 

0.002 

0.398 

2 

0.205 

0.002 

0.205 

3 

0.054 

0.001 

0.054 

4 

0.006 

0.000 

0.006 

rho-0. 1  c-0.85 

diag  -  2 

k 

phat 

error 

equl 

0 

0.431 

0.002 

0.430 

1 

0.384 

0.002 

0.385 

2 

0.150 

0.001 

0.151 

3 

0.031 

0.001 

0.031 

4 

0.003 

0.000 

0.003 

rho-0. 1  e 

-1.28 

diag  -  2 

k 

phat 

error 

equl 

0 

0.665 

0.002 

0.663 

1 

0.277 

0.002 

0.278 

2 

0.052 

0.001 

0.053 

3 

0.006 

0.001 

0.005 

4 

0.000 

0.000 

0.000 

rho-0. 1  c1 

-1.96 

diag  -  2 

k 

phat 

error 

equl 

0 

0.906 

0.001 

0.905 

1 

0.090 

0.001 

0.090 

2 

0.005 

0.000 

0.005 

3 

0.000 

0.000 

0.000 

4 

0.000 

0.000 

0.000 
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rho-0.3  c-0.0  diag  -  3 


k 

phat 

error 

equl 

0 

0.110 

0.001 

0.109 

1 

0.241 

0.002 

0.242 

2 

0.300 

0.002 

0.299 

3 

0.240 

0.002 

0.242 

4 

0.110 

0.001 

0.109 

rho-0.3  c-0.25  dlag  -  3 


k 

phat 

error 

equi 

0 

0.188 

0.002 

0.187 

1 

0.301 

0.002 

0.304 

2 

0.285 

0.002 

0.281 

3 

0.169 

0.001 

0.170 

4 

0.058 

0.001 

0.057 

rho-0.3  c-0.68  diag  “  3 


k 

phat 

error 

equi 

0 

0.384 

0.002 

0.380 

1 

0.339 

0.002 

0.346 

2 

0.192 

0.002 

0.190 

3 

0.071 

0.001 

0.070 

4 

0.015 

0.000 

0.014 

rho-0.3  c-0.85  diag  -  3 

k 

phat 

error 

equi 

0 

0.471 

0.002 

0.468 

1 

0.328 

0.002 

0.332 

2 

0.149 

0.001 

0.147 

3 

0.044 

0.001 

0.045 

4 

0.008 

0.000 

0.007 

rho 

-0.3  c 

-1.28 

diag  -  3 

k 

phat 

error 

equi 

0 

0.688 

0.002 

0.685 

1 

0.238 

0.002 

0.243 

2 

0,062 

0.001 

0.060 

3 

0,011 

0.000 

0.011 

4 

0.001 

0.000 

0.001 

rho-0.3  c-1.96 

diag  -  3 

k 

phat 

error 

equi 

0 

0.910 

0.001 

0.908 

1 

0.082 

0.0Q1 

0.084 

2 

0.008 

0.000 

0.007 

3 

0.001 

0.000 

0.001 

4 

0.000 

0.000 

0.000 

rho-0.3  c-0.0 

diag  -  2 

k 

phat 

error 

equi 

0 

0.109 

0.001 

0.108 

1 

0.241 

0.002 

0.242 

2 

0.301 

0.002 

0.301 

3 

0.241 

0.002 

0.242 

4 

0.109 

0.001 

0.108 

rho-0.3  c-0.25  diag  -  2 


k 

phat 

error 

equi 

0 

0.186 

0.002 

0.186 

1 

0.302 

0.002 

0.305 

2 

0.286 

0.002 

0.283 

3 

0.169 

0.001 

0.170 

4 

0.057 

0.001 

0.056 

rho1 

■0 . 3  c-0 . 68 

diag  -  2 

k 

phat 

error 

equi 

0 

0.382 

0.002 

0.378 

1 

0.341 

0.002 

0.347 

2 

0.192 

0.002 

0.191 

3 

0.070 

0.001 

0.070 

4 

0.014 

0.000 

0.014 

rho-0.3  c-0.85  diag  -  2 


k 

phat 

error 

equi 

0 

0.470 

0.002 

0.467 

1 

0.329 

0.002 

0.334 

2 

0.149 

0.001 

0.148 

3 

0.044 

0.001 

0.044 

4 

0.007 

0.000 

0.007 

rho-0 . 3  e 

-1.28 

diag  -  2 

k 

phat 

error 

equi 

0 

0.688 

0.002 

0.684 

1 

0.239 

0.002 

0.244 

2 

0.062 

0.001 

0.060 

3 

0.011 

0.000 

0.011 

4 

0.001 

0.00 0 

0.001 

rho-0.3  c-1.96 

diag  -  2 

k 

phat 

error 

equi 

0 

0.910 

0.001 

0.908 

1 

0.082 

0.001 

0.084 

2 

0.008 

0.000 

0.007 

3 

0.001 

0.000 

0.001 

4 

0.000 

0.000 

0.000 
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r ho -0.5  c-0.0  dlag  -  3 


k 

phat 

error 

equi 

0 

0.157 

0.001 

0.156 

1 

0.220 

0.002 

0.223 

2 

0.245 

0.002 

0.243 

3 

0.218 

0.002 

0.223 

4 

0.159 

0.001 

0.156 

rho-0.5  c-0.25 

diag  -  3 

k 

phat 

error 

equi 

0 

0.243 

0.002 

0.242 

1 

0.260 

0.002 

0.265 

2 

0.234 

0.002 

0.231 

3 

0.169 

0.001 

0.170 

4 

0.093 

0.001 

0.092 

rho-0.5  c-0.68  diag  -  3 


k 

phat 

error 

equi 

0 

0.440 

0.002 

0.434 

1 

0.275 

0.002 

0.285 

2 

0.170 

0.002 

0.167 

3 

0.085 

0.001 

0.084 

4 

0.031 

0.001 

0.030 

rho-0.5  c-0.85  diag  -  3 


k 

phat 

error 

equi 

0 

0.522 

0.002 

0.518 

1 

0.263 

0.002 

0.271 

2 

0.138 

0.001 

0.135 

3 

0.059 

0.001 

0.059 

4 

0.019 

0.001 

0.018 

rho-0.5  c-1.28  diag  -  3 
k  phat  error  equi 

0  0.720  0.002  0.714 

1  0.189  0.002  0.199 

2  0.068  0.001  0.064 

3  0.019  0.001  0.019 

4  0.004  0.000  0.004 

rho-0.5  c-1.96  diag  -  3 
k  phat  error  equi 

0  0.918  0.001  0.915 

1  0.068  0.001  0.072 

2  0.012  0.000  0.011 

3  0.002  0.000  0.002 

4  0.000  0.000  0.000 


rho-0.5  c-0.0  diag  -  2 
k  phat  error  equi 

0  0.152  0.001  0.150 

1  0.225  0.002  0.226 

2  0.247  0.002  0.249 

3  0.223  0.002  0.226 

4  0.153  0.001  0.150 

rho-0.5  c-0.25  diag  -  2 


k 

phat 

error 

equi 

0 

0.237 

0.002 

0.235 

1 

0.266 

0.002 

0.270 

2 

0.237 

0.002 

0.237 

3 

0.172 

0.001 

0.171 

4 

0.088 

0.001 

0.088 

rho-0.5  c-0.68  diag  -  2 


k 

phat 

error 

equi 

0 

0.434 

0.002 

0.427 

1 

0.281 

0.002 

0.292 

2 

0.171 

0.002 

0.170 

3 

0.086 

0.001 

0.083 

4 

0.028 

0.001 

0.028 

rho-0.5  c-0.85  diag  -  2 


k 

phat 

error 

equi 

0 

0.517 

0.002 

0.511 

1 

0.268 

0.002 

0.278 

2 

0.139 

0.001 

0.137 

3 

0.059 

0.001 

0.057 

4 

0.017 

0.001 

0.017 

rho-0.5  c-1.28  diag  -  2 
k  phat  error  equi 
0  0.718  0.002  0.710 

1  0.192  0.002  0.204 

2  0.068  0.001  0.064 

3  0.019  0.001  0.018 

4  0.003  0.000  0.004 

rho-0.5  c-1.96  diag  -  2 
k  phat  error  equi 
0  0.918  0.001  0.914 

1  0.069  0.001  0.074 

2  0.011  0.000  0.010 
3  0.002  0.000  0.002 
4  0.000  0.000  0.000 


rho-0.7  c-0.0  diag  -  3 


k 

phat 

error 

equi 

0 

0.226 

0.002 

0.223 

1 

0.182 

0.002 

0.187 

2 

0.183 

0.002 

0.180 

3 

0.180 

0.002 

0.187 

4 

0.229 

0.002 

0.223 

rho1 

-0.7  c-0.25  diag  -  3 

k 

phat 

error 

equi 

0 

0.321 

0.002 

0.317 

1 

0.202 

0.002 

0.209 

2 

0.175 

0.002 

0.173 

3 

0.151 

0.001 

0.154 

4 

0.151 

0.001 

0.147 

rho 

-0.7  c-0.68  diag  -  3 

k 

phat 

error 

equi 

0 

0.512 

0.002 

0.50) 

1 

0.199 

0.002 

0.211 

2 

0.137 

0.001 

0.132 

3 

0.089 

0.001 

0.091 

4 

0.063 

0.001 

0.062 

rho-0.7  c-0.85 

diag  -  3 

k 

phat 

error 

equi 

0 

0.587 

0.002 

0.581 

l 

0.187 

0.002 

0.198 

2 

0.116 

0.001 

0.111 

3 

0.069 

0.001 

0.069 

4 

0.042 

0.001 

0.041 

rho-0 . 7  c 

:-l .28 

diag  -  3 

k 

phat 

error 

equi 

0 

0.761 

0.002 

0.755 

1 

0.133 

0.001 

0.144 

2 

0.064 

0.001 

0.060 

3 

0.030 

0.001 

0.028 

4 

0.013 

0.000 

0.013 

rho-0 . 7  i 

e-1.96 

diag  -  3 

k 

phat 

error 

equi 

0 

0.928 

0.001 

0.926 

i 

0.051 

0.001 

0.055 

2 

0.015 

0.000 

0.014 

3 

0.005 

0.000 

0.004 

4 

0.001 

0.000 

0.001 

rho-0.7  c»0.0  diag  -  2 


k 

phat 

error 

equi 

0 

0.210 

0.002 

0.204 

1 

0.192 

0.002 

0.198 

2 

0.195 

0.002 

0.196 

3 

0.192 

0.002 

0.198 

4 

0.211 

0.002 

0.204 

rho-0 . 7  c-0 . 25 

diag  -  2 

k 

phat 

error 

equi 

0 

0.305 

0.002 

0.296 

1 

0.213 

0.002 

0.225 

2 

0.185 

0.002 

0.188 

3 

0.164 

0.001 

0.160 

4 

0.134 

0.001 

0.132 

rho— 0.7  c— 0.68  diag  —  2 


k 

phat 

error 

equi 

0 

0.500 

0.002 

0.486 

1 

0.207 

0.002 

0.230 

2 

0.143 

0.001 

0.142 

3 

0.098 

0.001 

0.090 

4 

0.052 

0.001 

0.052 

rho-0.7  c-0.85 

diag  -  2 

k 

phat 

error 

equi 

0 

0.578 

0.002 

0.564 

1 

0.193 

0.002 

0.217 

2 

0.120 

0.001 

0.118 

3 

0.076 

0.001 

0.067 

4 

0.033 

0.001 

0.034 

rho-0.7  c 

-1.28 

diag  -  2 

k 

phat 

error 

equi 

0 

0.756 

0.002 

0.743 

1 

0.138 

0.001 

0.159 

2 

0.065 

0.001 

0.062 

3 

0.033 

0.001 

0.027 

4 

0.008 

0.000 

0.010 

rho-0.7  c 

•1 .96 

diag  -  2 

k 

phat 

error 

equi 

0 

0.928 

0.001 

0.923 

1 

0.052 

0.001 

0.060 

2 

0.015 

0.000 

0.013 

3 

0.005 

0.000 

0.004 

4 

0.000 

0.000 

0.001 
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r ho -0.9  c-0.0 

dlag  -  3 

rho-0.9  c-0.85 

dlag  -  3 

k 

phat 

error 

equi 

k 

phat 

error 

equi 

0 

0.338 

0.002 

0.33S 

0 

0.680 

0.002 

0.680 

1 

0.111 

0.001 

0.121 

1 

0.096 

0.001 

0.097 

2 

0.101 

0.001 

0.087 

2 

0.069 

0.001 

0.066 

3 

0.110 

0.001 

0.121 

3 

0.058 

o.oot 

0.054 

4 

0.340 

0.002 

0.335 

4 

0.097 

0.001 

0.092 

rho-0.9  c-0.25 

dlag  »  3 

rho-0.9  c-1.28 

dlag  -  3 

k 

phat 

error 

equi 

k 

phat 

error 

equi 

0 

0.438 

0.002 

0.437 

0 

0.819 

0.001 

0.816 

1 

0.114 

0.001 

0.112 

1 

0.067 

0.001 

0.077 

2 

0.099 

0.001 

0.103 

2 

0.042 

0.001 

0.037 

3 

0.099 

0.001 

0.105 

3 

0.031 

0.001 

0.031 

4 

0.250 

0.002 

0.243 

4 

0.040 

0.001 

0.040 

rho> 

■0.9  c-0.68 

dlag  -  3 

rho-0.9  c-1.96 

dlag  -  3 

k 

phat 

error 

equi 

k 

phat 

error 

equi 

0 

0.616 

0.002 

0.611 

0 

0.948 

0.001 

0.946 

1 

0.104 

0.001 

0.117 

1 

0.025 

0.001 

0.029 

2 

0.079 

0.001 

0.068 

2 

0.012 

0.001 

0.011 

3 

0.068 

0.001 

0.075 

3 

0.008 

0.000 

0.007 

4 

0.132 

0.001 

0.128 

4 

0.007 

0.000 

0.007 

59 


rho-0. 1  c-0.0  diag  •  10 

rho-0. 1  c-0.85 

diag  -  10 

k 

phat 

error 

equi 

k 

phat 

error 

equi 

0 

0.002 

0.000 

0.002 

0 

0.125 

0.001 

0.124 

1 

0.014 

0.000 

0.014 

1 

0.270 

0.001 

0.272 

2 

0.051 

0.001 

0.052 

2 

0.285 

0.001 

0.287 

3 

0.121 

0.001 

0.121 

3 

0.191 

0.001 

0.191 

4 

0.196 

0.001 

0.197 

4 

0.090 

0.001 

0.089 

5 

0.230 

0.001 

0.230 

5 

0.030 

0.001 

0.030 

6 

0.196 

0.001 

0.197 

6 

0.007 

0.000 

0.007 

7 

0.123 

0.001 

0.121 

7 

0.001 

0.000 

0.001 

8 

0.051 

0.001 

0.052 

8 

0.000 

0.000 

0.000 

9 

0.014 

0.000 

0.014 

9 

0.000 

0.000 

0.000 

10 

0.002 

0.000 

0.002 

10 

0.000 

0.000 

0.000 

rho-0. 1  c-0.25 

diag  -  10 

rho-0 . 1  c 

-1.28 

diag  -  10 

k 

phat 

error 

equl 

k 

phat 

error 

equi 

0 

0.009 

0.000 

0.009 

0 

0.363 

0.002 

0.361 

1 

0.048 

0.001 

0.048 

1 

0.370 

0.002 

0.373 

2 

0.126 

0.001 

0.126 

2 

0.189 

0.001 

0.189 

3 

0.205 

0.001 

0.207 

3 

0.061 

0.001 

0.061 

4 

0.237 

0.001 

0.235 

4 

0.014 

0.000 

0.014 

5 

0.190 

0.001 

0.193 

5 

0.002 

0.000 

0.002 

6 

0.118 

0.001 

0.116 

6 

0.000 

0.000 

0.000 

7 

0.051 

0.001 

0.050 

7 

0.000 

0.000 

0.000 

8 

0.015 

0.000 

0.015 

8 

0.000 

0.000 

0.000 

9 

0.003 

0.000 

0.003 

9 

0.000 

0.000 

0.000 

10 

0.000 

0.000 

0.000 

10 

0.000 

0.000 

0.000 

rho1 

-0.1  c 

-0.68 

diag  -  10 

rho-0 . 1  c 

-1.96 

diag  -  10 

k 

phat 

error 

equi 

k 

phat 

error 

equi 

0 

0.069 

0.001 

0.068 

0 

0.780 

0.001 

0.779 

1 

0.196 

0.001 

0.196 

1 

0.193 

0.001 

0.194 

2 

0.269 

0.001 

0.271 

2 

0.024 

0.025 

0.024 

3 

0.235 

0.001 

0.235 

3 

0.002 

0.000 

0.002 

4 

0.142 

0.001 

0.142 

4 

0.000 

0.000 

0.000 

5 

0.063 

0.001 

0.062 

5 

0.000 

0.000 

0.000 

6 

0.021 

0.000 

0.020 

6 

0.000 

0.000 

0.000 

7 

0.004 

0.000 

0.005 

7 

0.000 

0.000 

0.000 

8 

0.001 

0.000 

0.001 

8 

0.000 

0.000 

0.000 

9 

0.000 

0.000 

0.000 

9 

0.000 

0.000 

0.000 

10 

0.000 

0.000 

0.000 

10 

0.000 

0.000 

0.000 
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rho-0.3  c-0.0  diag  -  10 

k  phat  error  equi 
0  0.006  0.000  0.005 

1  0.026  0.001  0.026 

2  0.068  0.001  0.068 

3  0.126  0.001  0.126 

4  0.175  0.001  0.176 

5  0.198  0.001  0.197 

6  0.176  0.001  0.176 

7  0.126  0.001  0.126 

8  0.068  0.001  0.068 

9  0.026  0.001  0.026 
10  0.006  0.001  0.005 

rho-0.3  c-0.25  diag  -  10 
k  phat  error  equi 
0  0.019  0.000  0.008 

1  0.068  0.001  0.047 

2  0.134  0.001  0.125 

3  0.187  0.001  0.208 

4  0.200  0.001  0.237 

5  0.171  0.001  0.194 

6  0.118  0.001  0.115 

7  0.065  0.001  0.049 

8  0.027  0.001  0.014 

9  0.007  0.000  0.003 

10  0.001  0.000  0.000 

rho-0.3  c-0.68  diag  -  10 

k  phat  error  equi 

0  0.102  0.001  0.066 

1  0.201  0.001  0.195 

2  0.239  0.001  0.272 

3  0.204  0.001  0.237 

4  0.136  0.001  0.142 

5  0.073  0.001  0.062 

6  0.030  0.001  0.019 

7  0.010  0.000  0.004 

8  0.003  0.000  0.001 

9  0.001  0.000  0.000 

10  0.000  0.000  0.000 


rho-0.3  c-0.85  diag  -  10 
k  phat  error  equi 
0  0.165  0.001  0.121 

1  0.260  0.001  0.272 

2  0.247  0.001  0.289 

3  0.172  0.001  0.192 

4  0.095  0.001  0.088 

5  0.041  0.001  0.029 

6  0.014  0.000  0.007 

7  0.004  0.000  0.001 

8  0.001  0.000  0.000 
9  0.000  0.000  0.000 
10  0.000  0.000  0.000 

rho-0.3  c-1.28  diag  -  10 

k  phat  error  equi 
0  0.401  0.002  0.359 

1  0.328  0.001  0.375 

2  0.173  0.001  0.189 

3  0.069  0.001  0.061 

4  0.022  0.000  0.014 

5  0.005  0.000  0.002 

6  0.001  0.000  0.000 
7  0.000  0.000  0.000 
8  0.000  0.000  0.000 
9  0.000  0.000  0.000 
10  0.000  0.000  0.000 

rho-0.3  c-1.96  diag  -  10 
k  phat  error  equi 
0  0.790  0.001  0.787 

1  0.173  0.001  0.180 
2  0.032  0.001  0.028 

3  0.005  0.000  0.004 

4  0.000  0.000  0.000 
•  5  0.000  0.000  0.000 

6  0.000  0.000  0.000 
7  0.000  0.000  0.000 
8  0.000  0.000  0.000 
9  0.000  0.000  0.000 
10  0.000  0.000  0.000 
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% 


rho-0.5  c-0.0  dlag  ■  10  rho-0.5  c-0.85  dlag  -  10 


k 

phat 

error 

equl 

k 

phat 

error 

equl 

0 

0.017 

0.000 

0.015 

0 

0.229 

0.001 

0.212 

1 

0.047 

0.001 

0.046 

1 

0.237 

0.C01 

0.254 

2 

0.082 

0.001 

0.085 

2 

0.202 

0.001 

0.210 

3 

0.122 

0.001 

0.123 

3 

0.147 

0.001 

0.145 

4 

0.151 

0.001 

0.150 

4 

0.094 

0.001 

0.090 

5 

0.159 

0.001 

0.160 

5 

0.051 

0.001 

0.050 

6 

0.150 

0.001 

0.150 

6 

0.025 

0.001 

0.025 

7 

0.123 

0.001 

0.123 

7 

0.010 

0.000 

0.011 

8 

0.084 

0.001 

0.085 

8 

0.004 

0.000 

0.004 

9 

0.047 

0.001 

0.046 

9 

0.001 

0.000 

0.001 

10 

0.018 

0.000 

0.015 

10 

0.000 

0.000 

0.000 

rho-0.5  c-0.25 

dlag  -  10 

rho1 

■0.5  c 

-1.28 

dlag  - 

k 

phat 

error 

equl 

k 

phat 

error 

equl 

0 

0.045 

0.001 

0.040 

0 

0.464 

0.002 

0.444 

1 

0.091 

0.001 

0.094 

1 

0.265 

0.001 

0.292 

2 

0.134 

0.001 

0.139 

2 

0.148 

0.001 

0.149 

3 

0.163 

0.001 

0.163 

3 

0.073 

0.001 

0.068 

4 

0.164 

0.001 

0.164 

4 

0.032 

0.001 

0.029 

5 

0.145 

0.001 

0.144 

5 

0.012 

0.000 

0.012 

6 

0.114 

0.001 

0.112 

6 

0.004 

0.000 

0.004 

7 

0.077 

0.001 

0.076 

7 

0.001 

0.000 

0.001 

8 

0.042 

0.001 

0.043 

8 

0.000 

0.000 

0.000 

9 

0.019 

0.000 

0.019 

9 

0.000 

0.000 

0.000 

10 

0.006 

0.000 

0.005 

10 

0.000 

0.000 

0.000 

rho-0.5  c-0.68 

dlag  -  10 

rho-0 . 5  c 

-1.96 

dlag  - 

k 

phat 

error 

equl 

k 

phat 

error 

equl 

0 

0.158 

0.001 

0.143 

0 

0.812 

0.001 

0.802 

1 

0.198 

0.001 

0.211 

1 

0.141 

0.001 

0.157 

2 

0.201 

0.001 

0.208 

2 

0.036 

0.001 

0.032 

3 

0.167 

0.001 

0.168 

3 

0.009 

0.000 

0.007 

4 

0.124 

0.001 

0.119 

4 

0.002 

0.000 

0.002 

5 

0.077 

0.001 

0.075 

5 

0.000 

0.000 

0.000 

6 

0.044 

0.001 

0.042 

6 

0.000 

0.000 

0.000 

7 

0.021 

0.000 

0.022 

7 

0.000 

0.000 

0.000 

8 

0.008 

0.000 

0.008 

8 

0.000 

0.000 

0.000 

9 

0.002 

0.000 

0.003 

9 

0.000 

0.000 

0.000 

10 

0.000 

0.000 

0.000 

10 

0.000 

0.000 

0.000 
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rho-0.7  c-0.0  diag  -  10  rho-0.7  c-0.85  diag  -  10 


k 

phat 

error 

equl 

k 

phat 

error 

equl 

0 

0.056 

0.001 

0.049 

0 

0.339 

0.002 

0.307 

1 

0.072 

0.001 

0.076 

1 

0.189 

0.001 

0.220 

2 

0.089 

0.001 

0.095 

2 

0.145 

0.001 

0.155 

3 

0.107 

0.001 

0.108 

3 

0.110 

0.001 

0.110 

4 

0.116 

0.001 

0.115 

4 

0.080 

0.001 

0.077 

5 

0.117 

0.001 

0.117 

5 

0.056 

0.001 

0.053 

6 

0.117 

0.001 

0.115 

6 

0.036 

0.001 

0.035 

7 

0.105 

0.001 

0.108 

7 

0.024 

0.000 

0.022 

8 

0.092 

0.001 

0.095 

8 

0.013 

0.000 

0.013 

9 

0.072 

0.001 

0.076 

9 

0.006 

0.000 

0.006 

10 

0.057 

0.001 

0.049 

10 

0.002 

0.000 

0.002 

rho-0.7  c-0.25 

diag  —  10 

rho-0 . 7  c 

-1.28 

diag  -  10 

k 

phat 

error 

equl 

k 

phat 

error 

equl 

0 

0.108 

0.001 

0.098 

0 

0.561 

0.002 

0.528 

1 

0.112 

0.001 

0.112 

1 

0.184 

0.001 

0.224 

2 

0.122 

0.001 

0.128 

2 

0.108 

0.001 

0.113 

3 

0.126 

0.001 

0.127 

3 

0.065 

0.001 

0.062 

4 

0.121 

0.001 

0.120 

4 

0.038 

0.001 

0.034 

5 

0.111 

0.001 

0.109 

5 

0.022 

0.000 

0.019 

6 

0.095 

0.001 

0.095 

6 

0.012 

0.000 

0.010 

7 

0.077 

0.001 

0.079 

7 

0.006 

0.000 

0.005 

8 

0.060 

0.001 

0.062 

8 

0.002 

0.000 

0.003 

9 

0.041 

0.001 

0.043 

9 

0.001 

0.000 

0.001 

10 

0.026 

0.001 

0.022 

10 

0.000 

0.000 

0.000 

rho-0.7  c-0.68 

diag  ■  10 

rho 

•0.7  c 

-1.96 

diag  •  10 

k 

phat 

error 

equl 

k 

phat 

error 

equl 

0 

0.261 

0.001 

0.231 

0 

0.849 

0.001 

0.830 

1 

0.174 

0.001 

0.199 

1 

0.092 

0.001 

0.119 

2 

0.147 

0.001 

0.159 

2 

0.035 

0.001 

0.032 

3 

0.123 

0.001 

0.124 

3 

0.015 

0.000 

0.011 

4 

0.097 

0.001 

0.095 

4 

0.006 

0.000 

0.004 

5 

0.072 

0.001 

0.070 

5 

0.002 

0.000 

0.002 

6 

0.052 

0.001 

0.050 

6 

0.001 

0.000 

0.001 

7 

0.037 

0.001 

0.035 

7 

0.000 

0.000 

0.000 

8 

0.021 

0.000 

0.022 

8 

0.000 

0.000 

0.000 

9 

0.012 

0.000 

0.012 

9 

0.000 

0.000 

0.000 

10 

0.005 

0.000 

0.004 

10 

0.000 

0.000 

0.000 
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rho-0.9  c-0.0  dlag  -  10 


k 

phat 

error 

equl 

0 

0.194 

0.001 

0.173 

1 

0.076 

0.001 

0.088 

2 

0.069 

0.001 

0.076 

3 

0.067 

0.001 

0.074 

4 

0.065 

0.001 

0.062 

5 

0.065 

0.001 

0.053 

6 

0.065 

0.001 

0.062 

7 

0.066 

0.001 

0.074 

8 

0.069 

0.001 

0.076 

9 

0.074 

0.001 

0.088 

10 

0.191 

0.001 

■).  173 

rho1 

•0.9  c-0.25 

dlag  *  10 

k 

phat 

error 

equl 

0 

0.281 

0.001 

0.252 

1 

0.091 

0.001 

0.116 

2 

0.076 

0.001 

0.086 

3 

0.071 

0.001 

0.063 

4 

0.064 

0.001 

0.060 

5 

0.062 

0.001 

0.067 

6 

0.060 

0.001 

0.064 

7 

0.057 

0.001 

0.054 

8 

0.056 

0.001 

0.057 

9 

0.060 

0.001 

0.072 

10 

0.123 

0.001 

0.110 

rho**0.9  c-0.68 

dlag  -  10 

k 

phat 

error 

equl 

0 

0.462 

0.002 

0.428 

1 

0.101 

0.001 

0.128 

2 

0.075 

0.001 

0.089 

3 

0.063 

0.001 

0.069 

4 

0.054 

0.001 

0.048 

5 

0.049 

0.001 

0.040 

6 

0.042 

0.001 

0.043 

7 

0.037 

0.001 

0.042 

8 

0.034 

0.001 

0.035 

9 

0.031 

0.001 

0.034 

10 

0.050 

0.001 

0.044 

rho-0.9  c-0.85  dlag  -  10 


k 

phat 

error 

equl 

0 

0.537 

0.002 

0.502 

1 

0.097 

0.001 

0.134 

2 

0.072 

0.001 

0.083 

3 

0.058 

0.001 

0.052 

4 

0.048 

0.001 

0.042 

5 

0.040 

0.001 

0.042 

6 

0.035 

0.001 

0.037 

7 

0.030 

0.001 

0.028 

8 

0.026 

0.001 

0.024 

9 

0.024 

0.001 

0.026 

10 

0.033 

0.001 

0.029 

rho-0.9  c 

-1.28 

dlag  -  1 

k 

phat 

error 

equl 

0 

0.715 

0.001 

0.687 

1 

0.080 

0.001 

0.109 

2 

0.051 

0.001 

0.059 

3 

0.038 

0.001 

0.041 

4 

0.029 

0.001 

0.025 

5 

0.023 

0.000 

0.018 

6 

0.019 

0.000 

0.017 

7 

0.015 

0.000 

0.015 

8 

0.011 

0.000 

0.011 

9 

0.008 

0.000 

0.009 

10 

0.009 

0.000 

0.009 

rho-0 . 9  c 

-1.96 

dlag  -  1 

k 

phat 

error 

equl 

0 

0.905 

0.001 

0.893 

1 

0.038 

0.001 

0.053 

2 

0.020 

0.000 

0.022 

3 

0.013 

0.000 

0.012 

4 

0.008 

0.000 

0.006 

5 

0.006 

0.000 

0.004 

6 

0.004 

0.000 

0.004 

7 

0.002 

0.000 

0.003 

8 

0.002 

0.000 

0.002 

9 

0.001 

0.000 

0.001 

10 

0.001 

0.000 

0.001 
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k 

0 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 


0.5  c-0.0  diag  -  2 

phat 

error 

equl 

0.013 

0.000 

0.011 

0.041 

0.001 

0.039 

0.076 

0.001 

0.081 

0.124 

0.001 

0.125 

0.159 

0.001 

0.159 

0.172 

0.001 

0.171 

0.159 

0.001 

0.159 

0.124 

0.001 

0.125 

0.079 

0.001 

0.081 

0.040 

0.001 

0.040 

0.014 

0.000 

0.011 

rho- 

k 

,0.5  c-0.25  oiag  - 

phat  error  equi 

0 

0.038  0.001 

0.031 

1 

0.084  0.001 

0.086 

2 

0.131  0.001 

0.139 

3 

0.171  0.001 

0.172 

4 

0.175  0.001 

0.175 

5 

0.155  0.001 

0.153 

6 

0.117  0.001 

0.115 

7 

0.074  0.001 

0.073 

8 

0.037  0.001 

0.038 

9 

0.015  0.000 

0.015 

10 

0.004  0.000 

0.003 

rho 

i«0.5  c-0.68  i 

diag  -  2 

k 

phat  error 

equi 

0 

0.144  0.001 

0.127 

1 

0.197  0.001 

0.211 

2 

0.206  0.001 

0.219 

3 

0.180  0.001 

0.180 

4 

0.129  0.001 

0.125 

5 

0.077  0.001 

0.075 

6 

0.040  0.001 

0.039 

7 

0.017  0.000 

0.017 

8 

0.006  0.000 

0.006 

9 

0.001  0.000 

0.002 

10 

0.000  0.000 

0.000 

rho-0.5  c-0.85  diag  -  2 


k 

phat 

error 

equi 

0 

0.216 

0.001 

0.194 

1 

0.237 

0.001 

0.259 

2 

0.212 

0.001 

0.223 

3 

0.157 

0.001 

0.154 

4 

0.096 

0.001 

0.091 

5 

0.049 

0.001 

0.047 

6 

0.021 

0.000 

0.021 

7 

0.008 

0.000 

0.008 

8 

0.003 

0.000 

0.003 

9 

0.001 

0.000 

0.001 

10 

0.000 

0.000 

0.000 

rho-0.5  c-1.28  diag  -  2 


phat 

error 

equi 

0.453 

0.002 

0.427 

0.272 

0.001 

0.308 

0.155 

0.001 

0.157 

0.077 

0.001 

0.068 

0.029 

0.001 

0.026 

0.010 

0.000 

0.009 

0.003 

0.000 

0.003 

0.001 

0.000 

0.001 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

rho-0.5  c 
k  phat 
0  0.809 

1  0.144 

2  0.036 

3  0.009 

4  0.002 

5  0.000 
6  0.000 
7  0.000 
8  0.000 

9  0.000 

10  0.000 


1.96  < 

diag  -  2 

error 

equi 

0.001 

0.797 

0.001 

0.165 

0.001 

0.031 

0.000 

0.006 

0.000 

0.001 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 
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Appendix  I 
Part  2. 


Sigma 

1.000  0.579  0.241 

0.579  1.000  0.582 

0.241  0.582  1.000 

loadings  0.579  0.950  0.582 
c  “  0.0 


k  phat 

error 

equi 

m. 1. fit 

0  0.243 

0.002 

0.241 

0.246 

1  0.258 

0.002 

0.259 

0.254 

2  0.255 

0.002 

0.259 

0.254 

3  0.245 

0.002 

0.241 

0.246 

distances 

0.006 

0.005 

c  -  0.68 

k  phat 

error 

equi 

m.l.f it 

0  0.534 

0.002 

0.532 

0.537 

1  0.252 

0.002 

0.259 

0.249 

2  0.145 

0.002 

0.142 

0.142 

3  0.069 

0.001 

0.068 

0.070 

distances 

0.008 

0.005 

Sigma 

1.000  0.717  -0.232 

0.717  1.000  -0.471 

-0.232  -0.471  1.000 

loadings  0.717  0.950  -0.471 

c  -  0.0 

k  phat 

error 

equi 

m.  l.f  it 

0  0.129 

0.002 

0.126 

0.121 

1  0.369 

0.002 

0.374 

0.379 

2  0.370 

0.002 

0.374 

0.379 

3  0.132 

0.002 

0.126 

0.121 

distances 

0.009 

0.020 

c  -  0.68 

k  phat 

error 

equi 

m.  l.f  it 

0  0.452 

0.002 

0.426 

0.328 

1  0.361 

0.002 

0.419 

0.254 

2  0.173 

0.002 

0.139 

0.152 

3  0.014 

0.001 

0.016 

0.010 

distances 

0.072 

0.165 
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Cfl 

Hi 

i 

1.000  0.600 

0.636 

0.472 

0.600  1.000 

0.383 

0.458 

0.636  0.383 

1.000 

0.705 

0.472  0.458 

0.705 

1.000 

loadings  0.729  0.561  0.863 

0.774 

c  “  0.0 

k  phat 

error 

equi 

a.l.fit 

0  0.216 

0.002 

0.214 

0.210 

1  0.185 

0.002 

0.192 

0.198 

2  0.198 

0.002 

0.188 

0.184 

3  0.184 

0.002 

0.192 

0.198 

4  0.218 

0.002 

0.214 

0.210 

distances 

0.016 

0.026 

Sig«« 


1.000 

0.585 

0.177 

0.197 

0.585 

1.000 

0.209 

0.217 

0.177 

0.209 

1.000 

0.291 

0.197 

0.217 

0.291 

1.000 

loadings  0.728  0.796  0.279 

0.294 

c  *  0.0 

k  phat 

error 

equi 

a.l.fit 

0  0.134 

0.002 

0.135 

0.128 

1  0.231 

0.002 

0.232 

0.240 

2  0.271 

0.002 

0.267 

0.264 

3  0.228 

0.002 

0.232 

0.240 

4  0.137 

0.002 

0.135 

0.128 

distances 

0.007 

0.020 

Signs 

0.704 

1.000  0.735 

0.711 

0.735  1.000 

0.693 

0.709 

0.711  0.693 

1.000 

0.839 

0.704  0.709 

0.839 

1.000 

loadings  0.803  0.797  0.904 

0.908 

c  ■  0.0 

k  phat 

error 

equl 

a.l.fit 

0  0.283 

0.002 

0.283 

0.282 

1  0.147 

0.002 

0.150 

0.154 

2  0.137 

0.002 

0.132 

0.128 

3  0.145 

0.002 

0.150 

0.154 

4  0.287 

0.002 

0.283 

0.282 

distances 

0.009 

0.016 
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Sigaa 

1.000  0.885 

0.905 

0.883 

0.885  1.000 

0.826 

0.769 

0.905  0.826 

1.000 

0.923 

0.883  0.769 

0.923 

1.000 

loadings  0.950  0.871 

0.963  0.938 

c  *  0.0 

k  phat 

error 

equi 

a.l.fit 

0  0.347 

0.002 

0.349 

0.354 

1  0.106 

0.001 

0.114 

0.114 

2  0.090 

0.001 

0.074 

0.064 

3  0.103 

0.001 

0.114 

0.114 

4  0.354 

0.002 

0.349 

0.354 

distances 

0.022 

0.031 

Sigma 

1.000  0.735 

0.711 

0.704 

0.735  1.000 

0.693 

0.709 

0.711  0.693 

1.000 

0.839 

0.704  0.709 

0.839 

1.000 

loadings  0.803  0.797  0.904 

0.908 

c  •  0.0 

k  phat 

error 

equi 

a.l.fit 

0  0.283 

0.002 

0.283 

0.282 

1  0.147 

0.002 

0.150 

0.154 

2  0.137 

0.002 

0.132 

0.128 

3  0.145 

0.002 

0.150 

0.154 

4  0.287 

0.002 

0.283 

0.282 

distances 

0.009 

0.016 

Sigma 

1.000  0.720 

-0.440 

0.600 

0.720  1.000 

-0.130 

0.680 

-0.440  -0.130 

1.000 

-0.290 

0.600  0.680 

-0.290 

1.000 

loadings  0.839  0.856  -0.337 

0.760 

c  -  0.0 

k  phat 

error 

equi 

a.l.fit 

0  0.104 

0.001 

0.110 

0.108 

1  0.292 

0.002 

0.241 

0.284 

2  0.206 

0.002 

0.297 

0.215 

3  0.293 

0,002 

0.241 

0.284 

4  0.104 

0.001 

0.110 

0.108 

distances 

0.117 

0.016 
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Sigma 


1.000  0.490 

0.390 

0.280 

0.170 

0.490  1.000 

0.680 

0.500 

0.470 

0.390  0.680 

1.000 

0.740 

0.680 

0.280  0.500 

0.740 

1.000 

0.730 

0.170  0.470 

0.680 

0.730 

1.000 

loadings  0.406  0.702  0.916  0.820 

c  -  0.0 

k  phat 

error 

equl 

m.l.fit 

0  0.171 

0.002 

0.171 

0.169 

1  0.170 

0.002 

0.165 

0.180 

2  0.156 

0.002 

0.164 

0.151 

3  0.155 

0.002 

0.164 

0.151 

4  0.174 

0.002 

0.165 

0.180 

5  0.173 

0.002 

0.171 

0.169 

distances 

0.015 

0.014 

Sigma 

1.000  0.553 

0.547 

0.410 

0.389 

0.553  1.000 

0.610 

0.485 

0.437 

0.547  0.610 

1.000 

0.711 

0.665 

0.410  0.485 

0.711 

1.000 

0.607 

0.389  0.437 

0.665 

0.607 

1.000 

loadings  0.646  0.711  0.864  0.786 

c  -  0.0 

k  phat 

error 

equi 

m.l.fit 

0  0.180 

0.002 

0.181 

0.187 

1  0.162 

0.002 

0.162 

0.163 

2  0.156 

0.002 

0.157 

0.149 

3  0.153 

0.002 

0.157 

0.149 

4  0.167 

0.002 

0.162 

0.163 

5  0.182 

0.002 

0.181 

0.187 

distances 

0.007 

0.013 

Sigma 

1.000  0.425 

-0.055 

-0.003 

0.193 

0.425  1.000 

-0.042 

0.049 

0.069 

-0.055  -0.042 

1.000 

0.747 

0.169 

-0.003  0.049 

0.747 

1.000 

0.265 

0.193  0.069 

0.169 

0.265 

1.000 

loadings  -0.030  0.056  0.747  0.265 

c  -  0.68 

k  phat 

error 

equi 

m.l.fit 

0  0.332 

0.002 

0.314 

0.186 

1  0.296 

0.002 

0.327 

0.248 

2  0.225 

0.002 

0.214 

0.183 

3  0.105 

0.001 

0.103 

0.096 

4  0.034 

0.001 

0.036 

0.029 

5  0.008 

0.000 

0.007 

0.003 

distances 

0.037 

0.160 
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Sigma 


1.000  0.584 

0.615 

0.601 

0.570  0.600 

0.584  1.000 

0.576 

0.530 

0.526  0.555 

0.615  0.576 

1.000 

0.940 

0.875  0.878 

0.601  0.530 

0.940 

1.000 

0.877  0.886 

0.570  0.526 

0.875 

0.877 

1.000  0.924 

0.600  0.555 

0.878 

0.886 

0.924  1.000 

loadings  0.637  0.584  0.959  0.960  0.929 

c  -  0.0 

k  phat 

error 

equi 

m.l.fit 

0  0.225 

0.002 

0.223 

0.215 

1  0.135 

0.001 

0.124 

0.166 

2  0.099 

0.001 

0.105 

0.090 

3  0.076 

0.001 

0.096 

0.057 

4  0.098 

0.001 

0.105 

0.090 

5  0.137 

0.001 

0.124 

0.166 

6  0.230 

0.002 

0.223 

0.215 

distances 

0.029 

0.051 

Sigma 

1.000  0.088 

0.334 

0.191 

0.173  0.123 

0.088  1.000 

0.186 

0.384 

0.262  0.040 

0.334  0.186 

1.000 

0.343 

0.144  0.080 

0.191  0.384 

0.343 

1.000 

0.375  0.142 

0.173  0.262 

0.144 

0.375 

1.000  0.334 

0.123  0.040 

0.080 

0.142 

0.334  1.000 

c  -  0.0 

k  phat 

error 

equi 

m.l.fit 

0  0.058 

0.001 

0.058 

0.056 

1  0.135 

0.002 

0.135 

0.138 

2  0.196 

0.002 

0.197 

0.197 

3  0.219 

0.002 

0.219 

0.217 

4  0.198 

0.002 

0.197 

0.197 

5  0.136 

0.002 

0.135 

0.138 

6  0.058 

0.001 

0.058 

0.056 

distances 

0.002 

0.006 

0.936 
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SlgM 


1.000 

0.440 

0.440 

0.110 

0.190 

0.100 

0.200 

0.200  -0.240 

0.440 

1.000 

0.340 

0.250 

0.320 

0.400 

0.490 

0.160  -0.220 

0.440 

0.340 

1.000 

0.040 

0.060 

0.080 

0.070 

0.050  -0.070 

0.110 

0.250 

0.040 

1.000 

0.180 

0.120 

0.230 

0.020  -0.200 

0.190 

0.320 

0.060 

0.180 

1.000 

0.220 

0.480 

0.140  -0.080 

0.100 

0.400 

0.080 

0.120 

0.220 

1.000 

0.400 

-0.110  -0.300 

0.200 

0.490 

0.070 

0.230 

0.480 

0.400 

1.000 

0.150  -0.130 

0.200 

0.160 

0.050 

0.020 

0.140 

-0.110 

0.150 

1.000  -0.100 

-0.240 

-0.220 

-0.070 

-0.200 

-0.080  -0.300 

-0.130 

-0.100  1.000 

loadings  0.514  0.728  0.346  0.328  0.509  0.299  0.660  0.223  -0.311 


c  ■ 

0.0 

k 

phat 

error 

equl 

o.l. fit 

0 

0.008 

0.000 

0.012 

0.009 

1 

0.049 

0.001 

0.047 

0.049 

2 

0.111 

0.001 

0.099 

0.107 

3 

0.156 

0.001 

0.154 

0.155 

4 

0.176 

0.002 

0.188 

0.180 

5 

0.178 

0.002 

0.188 

0.180 

6 

0.156 

0.001 

0.154 

0.155 

7 

0.110 

0.001 

0.099 

0.107 

8 

0.049 

0.001 

0.047 

0.049 

9 

0.008 

0.000 

0.012 

0.009 

distances 

0.023 

0.026 

c  “ 

0.68 

k 

phat 

error 

equi 

o.l. fit 

0 

0.128 

0.001 

0.137 

0.131 

1 

0.259 

0.002 

0.234 

0.252 

2 

0.234 

0.002 

0.238 

0.237 

3 

0.168 

0.001 

0.182 

0.171 

4 

0.108 

0.001 

0.114 

0.109 

5 

0.061 

0.001 

0.059 

0.061 

6 

0.030 

0.001 

0.025 

0.029 

7 

0.010 

0.000 

0.008 

0.010 

8 

0.002 

0.000 

0.002 

0.002 

9 

0.000 

0.000 

0.000 

0.000 

distances 

0.031 

0.009 
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Appendix  II 


n  ■  5 

k  true 

prob. 
0  0.033 

1  0.1S8 

2  0.309 

3  0.309 

4  0.158 

5  0.033 

n  -  10 
k  true 

prob. 

0  0.001 

1  0.011 

2  0.048 

3  0.119 

4  0.201 

5  0.239 

6  0.201 

7  0.119 

8  0.048 

9  0.011 

10  0.001 

n  -  15 
k  true 

prob. 

0  0.000 

1  0.001 

2  0.004 

3  0.017 

4  0.046 

5  0.094 

6  0.150 

7  0.188 

8  0.188 

9  0.150 

10  0.094 

11  0.046 

12  0.017 

13  0.004 

14  0.001 

15  0.000 


approx  froa 

expansion 

0.034 

0.158 

0.308 

0.308 

0.158 

0.034 


approx  froa 
expansion 
0.001 
0.012 
0.048 
0.120 
0.201 
0.238 
0.201 
0.120 
0.048 
0.012 
0.001 


approx  froa 
expansion 
0.000 
0.001 
0.005 
0.017 
0.047 
0.095 
0.149 
0.188 
0.188 
0.149 
0.095 
0.047 
0.017 
0.005 
0.001 
0.000 


c  -  0.0 

(1-0) 1+0$ >5  -  T(0) 
9  -  .02 


n  ■  5 


k 

true 

0 

prob. 

0.521 

1 

0.272 

2 

0.126 

3 

0.055 

4 

0.019 

5 

0.005 

n  ■ 

10 

k 

true 

0 

prob. 

0.353 

1 

0.245 

2 

0.159 

3 

0.101 

4 

0.063 

5 

0.038 

6 

0.022 

7 

0.012 

8 

0.006 

9 

0.002 

10 

0.000 

n  ■ 

15 

k 

true 

0 

prob. 

0.266 

1 

0.210 

2 

0.154 

3 

0.112 

4 

0.081 

5 

0.058 

6 

0.041 

7 

0.028 

8 

0.019 

9 

0.013 

10 

0.008 

11 

0.005 

12 

0.003 

13 

0.001 

14 

0.001 

15 

0.000 

approx  froa 

expansion 

0.761 

0.063 

0.092 

0.167 

0.090 

0.011 


approx  froa 
expansion 
1.345 
0.211 
-0.950 
-0.618 
0.266 
0.456 
0.220 
0.055 
0.008 
0.001 
0.000 


approx  froa 
expansion 
1.905 
1.236 
-0.993 
-2.106 
-1.233 
0.278 
0.890 
0.651 
0.276 
0.078 
0.019 
0.002 
0.000 
0.000 
0.000 
0.000 


c  “  1.0 

(l-8)I-t«t  5  •  T(9> 
0  »  .6 


L 
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distributed  random  vector  with  mean  zero  and  covariance  evaluate  the 
probability,  p^,  that  k  components  of  X  exceed  a  given  constant.  We 
call  (?q, ... ,pn)  the  exceedance  distribution  and  study  its  behavior  as  $ 
varies.  The  p^'s  can  be  expressed  as  multidimensional  integrals;  these 
expressions,  however,  are  not  helpful,  for  simulation  and  numerical  inte¬ 
gration  in  high  dimensions  are  very  expensive. 

>  * 

When  ^  is  an  ecuicorrelation  matrix  or  has  single-factor  structure, 
the  probabilities  can  be  written  as  single  integrals.  In  this  disserta¬ 
tion,  we  propose  some  methods  for  approximating  the  above  multidimensional 
integrals  by  such  single  integrals.  Ample  numerical  evidence  is  given  to 
show  that  the  approximations  are  quite  good.  We  also  prove  a  theorem 
which  gives  conditions  for  the  variance  of  the  exceedance  distribution  to 
be  greater  than  that  of  the  approximation.  We  use  this  Inequality  to 
improve  upon  earlier  .vproximatlons  and  inequalities. 

A  closely  related  problem  is  that  of  evaluating  "vanishing"  orthant 
probabilities:  i.e. ,  P{X^ >  a^, . . . ,Xn >  an>  for  large  a^.  A  natural 
approach  here  Is  to  use  generalizations  of  Mills'  ratio.  Several  authors 
have  studied  this  approach  and  stated  some  conjectures.  Studying  Mills' 
ratio  from  the  viewpoint  of  exponential  families,  we  provide  proofs  for 
some  of  the  conjectures  and  some  extensions. 

Finally,  wa  state  and  prove  soma  interesting  special  results  for  the 
equicorr elation  case.  This  case  lands  itself  to  much  analysis  because  of 
its  symmetry.  These  results  are  new  and  shad  some  light  on  other  results 
that  are  in  the  literature. 
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